-- Logs begin at Mon 2022-10-17 02:34:03 UTC, end at Mon 2022-10-17 03:31:53 UTC. -- Oct 17 03:03:12.645257 dv-cinder-846977-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Oct 17 03:03:12.654008 dv-cinder-846977-2-iscsi devstack@n-api.service[103854]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 17 03:03:12.655892 dv-cinder-846977-2-iscsi devstack@n-api.service[103854]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Oct 17 03:03:12 2022] *** Oct 17 03:03:12.655892 dv-cinder-846977-2-iscsi devstack@n-api.service[103854]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 17 03:03:12.655892 dv-cinder-846977-2-iscsi devstack@n-api.service[103854]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 17 03:03:12.655892 dv-cinder-846977-2-iscsi devstack@n-api.service[103854]: nodename: dv-cinder-846977-2-iscsi Oct 17 03:03:12.655892 dv-cinder-846977-2-iscsi devstack@n-api.service[103854]: machine: x86_64 Oct 17 03:03:12.655892 dv-cinder-846977-2-iscsi devstack@n-api.service[103854]: clock source: unix Oct 17 03:03:12.655892 dv-cinder-846977-2-iscsi devstack@n-api.service[103854]: pcre jit disabled Oct 17 03:03:12.655892 dv-cinder-846977-2-iscsi devstack@n-api.service[103854]: detected number of CPU cores: 4 Oct 17 03:03:12.655892 dv-cinder-846977-2-iscsi devstack@n-api.service[103854]: current working directory: / Oct 17 03:03:12.655892 dv-cinder-846977-2-iscsi devstack@n-api.service[103854]: detected binary path: /usr/bin/uwsgi-core Oct 17 03:03:12.656575 dv-cinder-846977-2-iscsi devstack@n-api.service[103854]: your processes number limit is 47680 Oct 17 03:03:12.656575 dv-cinder-846977-2-iscsi devstack@n-api.service[103854]: your memory page size is 4096 bytes Oct 17 03:03:12.656575 dv-cinder-846977-2-iscsi devstack@n-api.service[103854]: detected max file descriptor number: 2048 Oct 17 03:03:12.656575 dv-cinder-846977-2-iscsi devstack@n-api.service[103854]: lock engine: pthread robust mutexes Oct 17 03:03:12.656575 dv-cinder-846977-2-iscsi devstack@n-api.service[103854]: thunder lock: enabled Oct 17 03:03:12.656575 dv-cinder-846977-2-iscsi devstack@n-api.service[103854]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 17 03:03:12.656575 dv-cinder-846977-2-iscsi devstack@n-api.service[103854]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 17 03:03:12.695408 dv-cinder-846977-2-iscsi devstack@n-api.service[103854]: Python main interpreter initialized at 0x55c9cbb359c0 Oct 17 03:03:12.695408 dv-cinder-846977-2-iscsi devstack@n-api.service[103854]: python threads support enabled Oct 17 03:03:12.695408 dv-cinder-846977-2-iscsi devstack@n-api.service[103854]: your server socket listen backlog is limited to 100 connections Oct 17 03:03:12.695408 dv-cinder-846977-2-iscsi devstack@n-api.service[103854]: your mercy for graceful operations on workers is 90 seconds Oct 17 03:03:12.695784 dv-cinder-846977-2-iscsi devstack@n-api.service[103854]: mapped 403077 bytes (393 KB) for 2 cores Oct 17 03:03:12.695868 dv-cinder-846977-2-iscsi devstack@n-api.service[103854]: *** Operational MODE: preforking *** Oct 17 03:03:12.696064 dv-cinder-846977-2-iscsi devstack@n-api.service[103854]: *** uWSGI is running in multiple interpreter mode *** Oct 17 03:03:12.696064 dv-cinder-846977-2-iscsi devstack@n-api.service[103854]: spawned uWSGI master process (pid: 103854) Oct 17 03:03:12.696247 dv-cinder-846977-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Oct 17 03:03:12.697580 dv-cinder-846977-2-iscsi devstack@n-api.service[103854]: spawned uWSGI worker 1 (pid: 103855, cores: 1) Oct 17 03:03:12.697580 dv-cinder-846977-2-iscsi devstack@n-api.service[103854]: spawned uWSGI worker 2 (pid: 103856, cores: 1) Oct 17 03:03:12.697580 dv-cinder-846977-2-iscsi devstack@n-api.service[103854]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 17 03:03:13.351418 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 17 03:03:13.356348 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 17 03:03:14.462768 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 17 03:03:14.462768 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: from cryptography.utils import int_from_bytes Oct 17 03:03:14.463508 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 17 03:03:14.463508 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: from cryptography.utils import int_from_bytes Oct 17 03:03:14.512020 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 17 03:03:14.512020 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: from cryptography.utils import int_from_bytes Oct 17 03:03:14.512591 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 17 03:03:14.512591 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: from cryptography.utils import int_from_bytes Oct 17 03:03:17.006650 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 17 03:03:17.007346 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 17 03:03:17.007447 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 17 03:03:17.007789 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 17 03:03:17.008041 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 17 03:03:17.008420 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.008741 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.009055 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.009353 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 17 03:03:17.009703 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.009785 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 17 03:03:17.009873 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.009952 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.010137 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 17 03:03:17.010267 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.010500 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 17 03:03:17.010594 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.010759 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 17 03:03:17.010913 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.011175 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.011272 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.011485 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.011569 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.012060 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.012169 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-846977-2-iscsi {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.012374 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.012459 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.012675 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.012767 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.012979 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.013123 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.013287 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.013415 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.013584 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.013709 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.013897 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.014024 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.014152 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.014274 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.014470 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.014667 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.014833 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-846977-2-iscsi {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.015997 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.016157 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.016157 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.016416 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.016627 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.016762 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.016885 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.017007 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.017007 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.017249 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.017249 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.017490 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.017619 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.017748 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.017860 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.017987 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.018134 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.018258 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.018389 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.018511 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.018643 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-846977-2-iscsi {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.018643 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.018902 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.019027 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.019147 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.019281 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.019415 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.019527 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.019648 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.019770 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.019898 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.020063 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.020190 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.020375 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.020499 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.020689 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.020824 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.020990 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.021117 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-846977-2-iscsi {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.021319 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.021453 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.021636 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.021773 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.021946 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.022096 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.022297 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.022425 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.022626 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.022759 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.022904 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.023047 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.023189 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.023323 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.023446 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.023645 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.023778 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.023953 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.024080 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.024211 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.024332 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.024509 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.024652 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.024824 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.024950 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.025118 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.025244 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.025435 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.025575 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.025699 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.025822 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.025944 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.026056 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.026211 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.026368 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.026522 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.026656 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.026822 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.027079 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.027216 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.027350 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.027474 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.027607 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.027737 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.027860 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.027990 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.028115 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.028287 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.028412 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.028584 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.028721 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.028881 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.029005 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.029191 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.029317 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.029498 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.029636 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.029802 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.029933 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.030099 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.030231 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.030401 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.030534 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.030708 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.030840 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.27 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.031037 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.27 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.031176 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.031338 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.031465 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.031640 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.031763 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.031946 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.032072 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.032265 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.032458 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.032585 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.032715 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.032850 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.032973 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.033143 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.033264 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.033440 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.034115 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.034280 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.034466 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.27 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.034606 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.034799 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.27 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.034945 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.035147 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.035283 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.035447 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.035578 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.035743 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.035871 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.036041 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.036172 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.036351 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.036479 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.036647 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.036882 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.037030 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.037155 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.037286 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.037409 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.037531 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.037662 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.037793 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.037923 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.038058 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.038215 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.038348 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.038519 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.038645 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.038774 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.038998 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.039157 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.039279 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.039401 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.039522 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.039678 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.039806 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.039985 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.040111 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.040290 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.040422 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.040593 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.040728 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.040893 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.041026 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.041198 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.041324 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.041530 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.041656 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.041778 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.041908 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.042076 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.042201 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.042376 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.042581 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.042709 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.042830 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.042975 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.043102 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.043276 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.043397 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.043572 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.043709 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.043869 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.043995 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.044178 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.044305 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.044475 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.044600 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.044775 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.044915 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.045074 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.045247 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.045386 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.045509 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.045630 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.045760 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.045941 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.046078 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.046238 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.046369 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.046535 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.046669 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.046829 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.047015 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.047165 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.047291 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.047459 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.047595 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.047756 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.047882 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.048050 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.048175 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.048347 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.048523 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.048648 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.048770 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.048936 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.049064 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.049853 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.050000 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.050160 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.050310 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.050542 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.050667 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.050846 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.050994 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.051183 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.051311 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.051511 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.051638 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.051834 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.051967 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.052144 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.052278 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.052450 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.052591 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.052790 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.052919 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.053050 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.053172 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.053349 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.053475 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.053670 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.053797 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.053977 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.054101 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.054284 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.054417 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.054588 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.054712 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.054913 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.055055 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:03:17.055224 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.055354 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.055537 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.055663 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.055848 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.055973 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.056170 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.056304 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.056481 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.056606 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.056793 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.056917 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.057104 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.057231 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.057411 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.057558 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.057725 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.057853 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.058047 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.058182 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.058356 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.058482 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.058660 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.058791 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.058994 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.059130 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.059315 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.059442 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.059634 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.059761 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.059969 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.060105 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.060288 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.060414 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.060600 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.060733 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.060905 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.061034 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.061208 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.061334 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.061523 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.061661 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.061832 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.061965 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.062141 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.062268 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.062452 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.062590 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.062812 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.063026 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.063166 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.063291 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.063414 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.063546 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.063659 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.063780 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.063954 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.064089 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.064285 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.064424 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.064588 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.064722 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.064985 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.065117 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.065330 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.065480 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.065643 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.065771 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.065954 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.066086 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.066262 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.066398 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.066575 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.066700 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.066895 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.067024 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.067207 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.067345 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.067513 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.067639 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.067813 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.067940 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.068113 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.068241 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.068414 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.068548 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.068719 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.068845 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.069017 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.069145 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.069331 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.069458 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.069649 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.069775 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.069950 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.070078 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.070266 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.070391 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.070567 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.070698 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.070883 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.071024 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.071202 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.071329 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.071505 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.071644 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.071802 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.071927 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.072106 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.072247 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.072409 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.072552 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.072708 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.072835 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.073027 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.073148 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.073334 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.073447 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.073631 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.073752 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.073946 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.074045 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.074243 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.074354 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.074543 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.074648 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.074851 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.074984 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.075182 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.075273 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.075484 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.075587 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.075790 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.075878 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.076093 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.076182 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.076398 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.076491 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.076699 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.076785 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.077004 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.077092 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.077311 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.077415 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.077635 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.077731 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.077930 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.078025 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.078235 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.078321 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.078549 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.078643 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.078857 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.078957 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.079178 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.079263 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.079483 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.079588 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.079782 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.079870 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.080078 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.080165 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.080404 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.080506 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.080814 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.080923 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.081155 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.081339 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.081483 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.081689 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.081779 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.081993 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.082081 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.082299 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.082395 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.082601 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.082691 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.082944 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.083036 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.083250 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.083350 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.083548 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.083637 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.083847 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.083937 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.084145 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.084242 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.084480 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.084640 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.084800 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.084946 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.085084 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.085231 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.085368 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.085503 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.085638 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.085789 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.085934 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.086070 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.086251 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.086395 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.086558 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.086700 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.086846 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.087042 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.087179 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.087314 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.087459 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.087635 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.087781 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.087918 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.088054 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.088195 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.088355 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.088497 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.088664 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.088807 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.088968 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.089110 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.089281 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.089432 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.089578 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.089723 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.089880 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.090023 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.090179 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.090329 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.090486 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.090629 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.090792 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.090959 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.091126 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.091347 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.091485 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.091637 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.091773 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.091907 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.092043 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.092193 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.092328 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.092464 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.092640 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.092785 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.092950 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.093101 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.093255 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.093464 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.093633 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.093883 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.094051 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.094193 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.094193 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.094504 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.094646 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.094781 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.094965 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.095116 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.095255 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.095389 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.095523 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.095669 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.095813 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.095956 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.096631 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.096794 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.096931 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.097191 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.097375 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.097517 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.097652 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.097788 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.097923 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.098077 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.098214 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.098350 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.098485 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.098619 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.098753 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.098919 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.099109 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.099252 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.099389 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.099523 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.099658 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.099801 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.099948 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.100083 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.100218 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.100351 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.100493 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.100638 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.100773 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.100908 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.101042 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.101177 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.101321 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.101458 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.101593 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.101738 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.101873 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.102007 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.102151 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.102288 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.102422 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.102564 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.102699 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.102834 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.103019 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.103164 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.103299 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.103450 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.103670 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.103820 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.103965 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.104109 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.104253 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.104388 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.104522 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.104665 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.104807 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.104943 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.105087 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.105237 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.105373 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.105526 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.105664 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.105798 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.105932 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.106077 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.106213 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.106357 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.106500 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.106635 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.106770 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.106955 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.107113 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.107269 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.107404 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.107539 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.107679 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.107876 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.108041 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.108189 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.108364 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.108505 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.108640 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.108776 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.108924 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.109068 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.109225 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.109362 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.109496 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.109629 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.109771 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.109908 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.110043 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.110176 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.110318 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.110454 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.110601 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.110737 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.110904 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.111058 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.111194 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.111341 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.111477 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.111665 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.111820 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.112111 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.112249 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.112394 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.112528 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.112712 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.112855 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.113023 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.113333 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.113484 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.113627 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.113862 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.114006 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.114143 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.114284 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.114429 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.114564 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.114705 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.114850 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.115065 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.115223 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.115367 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.115514 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.115658 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.115802 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.115938 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.116073 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.116209 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.116352 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.116496 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.116688 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.116877 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.117019 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.117248 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.117388 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.117524 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.117659 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.117823 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.117967 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.118111 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.118248 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.118392 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.118536 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.118680 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.118822 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.118991 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.119152 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.119290 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.119426 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.119560 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.119694 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.119859 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.120010 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.120146 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.120282 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.120450 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.120592 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.120749 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.120901 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.121068 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.121218 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.121356 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.121490 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.121653 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.121804 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.121941 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.122082 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.122218 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.122360 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.122556 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.122782 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.122986 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.123130 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.123265 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.123399 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.123547 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.123683 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.123817 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.124040 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.124182 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.124300 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.124405 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.124500 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.124708 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.124797 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.125007 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.125112 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.125306 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.125395 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.125600 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.125690 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.125903 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.126007 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.126202 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.126290 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.126497 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.126595 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.126800 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.126939 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.127125 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.127214 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.128070 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.128171 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.128378 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.128476 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.128674 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.128760 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.128978 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.129073 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.129276 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.129365 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.129578 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.129665 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.129877 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.129962 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.130174 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.130263 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.130468 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.130555 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.130768 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.130855 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.131092 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.131202 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.131390 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.131486 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.131689 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.131777 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.131983 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.132079 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.132287 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.132372 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.132582 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.132676 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.132879 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.132974 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.133174 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.133262 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.133480 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.133574 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.133777 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.133862 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.134073 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.134160 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.134381 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.134490 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.134678 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.134764 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.135000 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.135102 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.135297 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.135392 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.135598 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.135686 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.135905 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.135995 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.136191 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.136280 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.136491 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.136576 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.137063 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.137163 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.137369 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.137456 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.137667 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.137754 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.137967 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.138068 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.138263 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.138361 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.138555 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.138650 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.138850 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.138965 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.139173 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.139263 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.139469 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.139565 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.139764 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.139860 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.140059 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.140146 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.140354 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.140441 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.140649 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.140745 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.140961 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.141048 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.141262 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.141397 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.141562 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.141663 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.141850 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.141937 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.142143 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.142230 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.142443 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.142538 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.142749 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.142836 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.143650 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.143798 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.143975 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.144104 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.144235 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.144419 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.144531 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.144736 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.144841 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.145043 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.145135 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.145350 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.145441 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.145659 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.145760 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.145956 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.146070 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.146264 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.146354 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.146567 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.146730 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.146909 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.147059 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.147213 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.147356 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.147497 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.147659 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.147802 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.147943 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.148084 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.148225 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.148374 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.148524 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.148667 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.148808 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.148956 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.149109 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.149260 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.149419 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.149561 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.149704 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.149852 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.149993 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.150142 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.150284 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.150434 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.150583 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.150725 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.150885 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.151047 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.151191 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.151364 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.151513 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.151654 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.151808 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.151950 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.152090 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.152240 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.152382 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.152522 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.152681 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.152825 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.152973 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.153126 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.153278 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.153420 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.153569 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.153710 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.153859 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.154002 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.154143 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.154371 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.154530 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.154674 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.154822 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.154988 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.155132 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.155295 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.155439 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.155581 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.155723 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.155864 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.156006 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.156156 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.156299 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.156441 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.156589 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.156732 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.156872 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.157033 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.157176 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.157317 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.157465 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.157607 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.157756 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.157906 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.158049 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.158197 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.158338 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.158479 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.159181 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.159282 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.159442 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.159569 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.159745 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.159865 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.160172 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.160264 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.160472 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.160559 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.160774 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.160872 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.161078 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.161166 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.161390 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.161499 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.161692 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.161798 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.161990 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.162078 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.162290 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.162378 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.162590 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.162685 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.162910 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.163030 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.163230 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.163345 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.163645 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.163746 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.163953 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.164040 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.164250 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.164344 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.164553 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.164652 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.164863 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.164951 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.165186 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.165272 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.165492 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.165588 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.165800 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.165894 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.166105 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.166206 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.166428 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.166517 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.166732 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.166818 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.167060 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.167175 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.167378 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.167466 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.167695 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.167783 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.168000 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.168094 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.168308 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.168485 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.168605 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.168779 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.168920 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.169090 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.169235 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.169411 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.169541 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.169733 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.169856 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.170059 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.170261 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.170349 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.170578 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.170667 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.170897 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.170990 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.171216 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.171316 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.171537 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.171632 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.171839 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.171940 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.172137 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.172234 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.172443 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.172539 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.172743 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.172831 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.173041 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.173141 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.173357 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.173454 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.173662 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.173750 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.173967 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.174108 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.174421 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.174554 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.174733 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.174901 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.175070 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.175190 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.175373 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.175471 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.175691 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.175779 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.175991 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.176080 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.176307 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.176395 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.176616 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.176705 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.176951 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.177132 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.177249 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.177345 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.177549 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.177637 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.177866 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.177956 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.178170 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.178257 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.178469 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.178570 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.178768 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.178857 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.179092 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.179180 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.179423 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.179528 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.179718 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.179801 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.180033 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.180123 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.180344 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.180439 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.180663 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.180749 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.180966 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.181053 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.181272 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.181367 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.181595 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.181683 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.181909 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.182018 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.182215 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.182316 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.182514 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.182609 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.182820 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.182937 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.183145 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.183236 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.183448 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.183537 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.183751 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.183839 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.184048 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.184145 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.184344 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.184432 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.184641 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.184729 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.184940 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.185037 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.185236 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.185325 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.185534 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.185632 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.185829 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.185917 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.186143 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.186230 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.186441 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.186538 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.186754 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.186843 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.187081 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.187200 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.187380 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.187494 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.187678 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.187774 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.187972 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.188067 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.188305 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.188402 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.188603 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.188698 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.188916 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.189010 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.189217 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.189306 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.189519 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.189615 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.189876 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.190196 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.190196 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.190436 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.190518 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.190597 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.190779 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.190897 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.191108 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.191203 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.191415 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.191513 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.191720 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.191809 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.192027 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.192136 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.192339 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.192443 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.192647 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.192749 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.192957 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.193049 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.193280 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.193477 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.193594 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.193801 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.193895 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.194110 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.194199 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.194418 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.194513 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.194725 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.194815 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.195065 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.195154 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.195373 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.195460 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.195678 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.195776 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.195982 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.196071 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.196287 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.196383 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.196590 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.196679 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.196910 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.197159 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.197247 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.197488 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.197579 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.197804 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.197894 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.198120 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.198208 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.198435 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.198524 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.198744 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.198830 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.199082 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.199185 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.199395 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.199492 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.199710 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.199805 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.200017 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.200113 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.200327 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.200421 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.200636 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.200721 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.200945 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.201034 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.201250 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.201338 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.201555 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.201643 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.201863 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.201952 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.202172 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.202281 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.202473 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.202561 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.202776 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.202891 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.203111 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.203201 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.203424 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.203529 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.203740 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.203842 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.204066 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.204175 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.204376 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.204492 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.204681 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.204769 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.204990 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.205080 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.205297 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.205886 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.206132 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.206447 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.206580 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.206757 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.206946 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.207091 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.207359 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.207448 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.207688 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.207776 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.208012 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.208111 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.208325 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.208463 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.208639 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.208727 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.208948 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.209080 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.209248 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.209334 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.209550 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.209647 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.209855 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.210070 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.210196 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.210388 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.210477 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.210721 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.210812 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.211062 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.211151 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.211361 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.211449 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.211674 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.211763 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.211977 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.212065 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.212305 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.212501 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.212612 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.212843 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.212921 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.213153 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.213229 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.213470 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.213550 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.213792 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.213869 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.214104 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.214192 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.214403 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.214482 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.214705 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.214788 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.215033 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.215114 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.215334 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.215421 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.215642 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.215869 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.215946 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.216224 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.216302 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.216518 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.216594 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.216824 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.216901 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.217127 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.217205 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.217422 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.217499 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.217725 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.217809 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.218020 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.218105 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.218338 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.218423 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.218636 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.218731 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.218958 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.219056 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.219257 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.219363 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.219561 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.219667 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.219857 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.219947 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.220152 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.220278 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.220450 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.220547 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.220746 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.220834 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.221118 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.221710 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.221926 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.222053 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.222255 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.222416 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.222565 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.222654 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.222888 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.223058 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.223192 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.223304 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.223497 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.223591 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.223802 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.223903 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.224110 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.224205 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.224413 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.224515 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.224718 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.224816 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.225031 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.225120 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.225335 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.225421 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.225642 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.225738 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.225944 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.226032 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.226248 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.226345 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.226586 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.226675 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.226911 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.227017 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.227220 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.227448 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.227616 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.227778 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.227868 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.228096 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.228183 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.228421 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.228511 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.228727 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.228822 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.229033 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.229127 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.229335 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.229539 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.229884 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.230011 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.230140 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.230227 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.230327 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.230406 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.230517 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.230790 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.230955 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.231138 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.231227 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.231443 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.231531 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.231747 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.231835 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.232051 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.232141 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.232354 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.232480 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.232655 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.232744 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.232953 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.233043 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.233255 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.233343 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.233557 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.233645 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.233864 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.233958 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.234164 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.234268 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.234469 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.234577 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.234776 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.234898 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.235111 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.235214 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.235419 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.235533 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.235727 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.235827 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.236033 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.236120 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.236336 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.236435 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.236663 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.236751 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.236974 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.237068 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.237313 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.237442 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.237622 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.237762 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.237944 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.238081 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.238251 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.238426 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.238548 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.238745 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.239088 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.239256 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.239412 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.239567 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.239708 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.239881 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.240023 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.240197 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.240333 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.240503 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.240642 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.240819 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.240951 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.241137 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.241266 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.241442 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.241595 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.241756 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.241909 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.242059 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.242212 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.242383 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.242715 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.242915 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.243063 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.243236 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.243382 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.243559 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.243684 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.243883 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.243982 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.244195 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.244301 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.244520 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.244613 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.244846 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.244948 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.245149 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.245258 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.245445 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.245534 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.245741 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.245847 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.246041 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.246130 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.246335 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.246430 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.246632 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.246721 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.246951 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.247057 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.247253 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.247346 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.247552 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.247686 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.247845 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.247938 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.248141 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.248246 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.248435 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.248550 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.248731 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.248824 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.249025 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.249179 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.249321 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.249421 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.249620 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.249726 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.249914 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.250017 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.250210 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.250304 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.250502 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.250645 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.250800 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.250929 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.251120 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.251209 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.251445 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.251534 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.251745 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.251842 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.252049 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.252139 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.252401 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.252631 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.252733 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.252823 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.252985 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.253084 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.253290 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.253386 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.253588 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.253677 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.253895 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.253989 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.254197 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.254302 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.254498 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.254591 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.254814 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.255006 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.255138 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.255227 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.255443 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.255533 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.255749 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.255845 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.256054 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.256219 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.256358 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.256448 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.256705 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.256800 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.256973 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.257095 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.257289 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.257380 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.257588 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.257699 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.257904 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.258010 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.258211 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.258303 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.258520 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.258619 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.258829 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.258957 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.259157 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.259245 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.259468 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.259572 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.259771 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.259863 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.260074 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.260185 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.260376 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.260480 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.260678 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.260768 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.260980 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.261076 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.261286 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.261384 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.261589 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.261682 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.262155 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.262249 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.262460 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.262560 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.262768 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.262914 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.263102 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.263206 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.263417 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.263535 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.263722 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.263824 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.264030 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.264128 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.264342 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.264444 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.264653 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.264742 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.264965 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.265070 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.265280 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.265374 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.265592 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.265690 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.265892 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.265989 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.266200 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.266295 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.266495 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.266597 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.266735 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 17 03:03:17.266921 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.267158 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.267473 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.267798 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.268812 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.269213 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.269537 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.269887 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.270222 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.270540 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.270856 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.271190 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:03:17.271437 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 17 03:03:17.419758 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: INFO dbcounter [None req-15c68653-d118-43a1-9fe9-71e2311c678d None None] Registered counter for database nova_api Oct 17 03:03:17.423902 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: INFO dbcounter [None req-1e733090-2f8e-46b4-ae08-759ce22104ab None None] Registered counter for database nova_api Oct 17 03:03:17.439782 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG oslo_db.sqlalchemy.engines [None req-15c68653-d118-43a1-9fe9-71e2311c678d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103855) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 17 03:03:17.443765 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG oslo_db.sqlalchemy.engines [None req-1e733090-2f8e-46b4-ae08-759ce22104ab None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103856) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 17 03:03:17.446894 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG dbcounter [-] [103855] Writer thread running {{(pid=103855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 17 03:03:17.450226 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG dbcounter [-] [103856] Writer thread running {{(pid=103856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 17 03:03:17.503548 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.context [None req-15c68653-d118-43a1-9fe9-71e2311c678d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),bae72ffa-7a7a-461b-9de6-69e8d04af1a1(cell1) {{(pid=103855) load_cells /opt/stack/nova/nova/context.py:464}} Oct 17 03:03:17.506991 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.context [None req-1e733090-2f8e-46b4-ae08-759ce22104ab None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),bae72ffa-7a7a-461b-9de6-69e8d04af1a1(cell1) {{(pid=103856) load_cells /opt/stack/nova/nova/context.py:464}} Oct 17 03:03:17.507540 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG oslo_concurrency.lockutils [None req-15c68653-d118-43a1-9fe9-71e2311c678d None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:03:17.508008 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG oslo_concurrency.lockutils [None req-15c68653-d118-43a1-9fe9-71e2311c678d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:03:17.509556 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG oslo_concurrency.lockutils [None req-15c68653-d118-43a1-9fe9-71e2311c678d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:03:17.510273 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG oslo_concurrency.lockutils [None req-15c68653-d118-43a1-9fe9-71e2311c678d None None] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:03:17.510684 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG oslo_concurrency.lockutils [None req-1e733090-2f8e-46b4-ae08-759ce22104ab None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:03:17.510774 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG oslo_concurrency.lockutils [None req-15c68653-d118-43a1-9fe9-71e2311c678d None None] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:03:17.511246 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG oslo_concurrency.lockutils [None req-1e733090-2f8e-46b4-ae08-759ce22104ab None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:03:17.512948 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG oslo_concurrency.lockutils [None req-15c68653-d118-43a1-9fe9-71e2311c678d None None] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:03:17.513051 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG oslo_concurrency.lockutils [None req-1e733090-2f8e-46b4-ae08-759ce22104ab None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:03:17.513768 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG oslo_concurrency.lockutils [None req-1e733090-2f8e-46b4-ae08-759ce22104ab None None] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:03:17.514222 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG oslo_concurrency.lockutils [None req-1e733090-2f8e-46b4-ae08-759ce22104ab None None] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:03:17.514928 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: INFO dbcounter [None req-15c68653-d118-43a1-9fe9-71e2311c678d None None] Registered counter for database nova_cell0 Oct 17 03:03:17.516241 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG oslo_concurrency.lockutils [None req-1e733090-2f8e-46b4-ae08-759ce22104ab None None] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:03:17.518830 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: INFO dbcounter [None req-1e733090-2f8e-46b4-ae08-759ce22104ab None None] Registered counter for database nova_cell0 Oct 17 03:03:17.519757 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: INFO dbcounter [None req-15c68653-d118-43a1-9fe9-71e2311c678d None None] Registered counter for database nova_cell1 Oct 17 03:03:17.522932 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: INFO dbcounter [None req-1e733090-2f8e-46b4-ae08-759ce22104ab None None] Registered counter for database nova_cell1 Oct 17 03:03:17.527736 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG oslo_db.sqlalchemy.engines [None req-15c68653-d118-43a1-9fe9-71e2311c678d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103855) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 17 03:03:17.530146 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG oslo_db.sqlalchemy.engines [None req-15c68653-d118-43a1-9fe9-71e2311c678d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103855) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 17 03:03:17.530667 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG oslo_db.sqlalchemy.engines [None req-1e733090-2f8e-46b4-ae08-759ce22104ab None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103856) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 17 03:03:17.534231 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG oslo_db.sqlalchemy.engines [None req-1e733090-2f8e-46b4-ae08-759ce22104ab None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103856) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 17 03:03:17.535993 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG dbcounter [-] [103855] Writer thread running {{(pid=103855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 17 03:03:17.537097 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG dbcounter [-] [103856] Writer thread running {{(pid=103856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 17 03:03:17.538256 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG dbcounter [-] [103855] Writer thread running {{(pid=103855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 17 03:03:17.673963 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG dbcounter [-] [103856] Writer thread running {{(pid=103856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 17 03:03:17.683354 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: INFO dbcounter [None req-1e733090-2f8e-46b4-ae08-759ce22104ab None None] Registered counter for database nova_cell0 Oct 17 03:03:17.684921 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: INFO dbcounter [None req-15c68653-d118-43a1-9fe9-71e2311c678d None None] Registered counter for database nova_cell0 Oct 17 03:03:17.692472 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG oslo_db.sqlalchemy.engines [None req-1e733090-2f8e-46b4-ae08-759ce22104ab None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103856) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 17 03:03:17.696330 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG oslo_db.sqlalchemy.engines [None req-15c68653-d118-43a1-9fe9-71e2311c678d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103855) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 17 03:03:17.697056 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG dbcounter [-] [103856] Writer thread running {{(pid=103856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 17 03:03:17.700696 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG dbcounter [-] [103855] Writer thread running {{(pid=103855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 17 03:03:18.034356 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: WARNING keystonemiddleware.auth_token [None req-1e733090-2f8e-46b4-ae08-759ce22104ab None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 17 03:03:18.037551 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: WARNING keystonemiddleware.auth_token [None req-15c68653-d118-43a1-9fe9-71e2311c678d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 17 03:03:18.041545 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: WARNING keystonemiddleware.auth_token [None req-1e733090-2f8e-46b4-ae08-759ce22104ab None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 17 03:03:18.044761 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: WARNING keystonemiddleware.auth_token [None req-15c68653-d118-43a1-9fe9-71e2311c678d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 17 03:03:18.383454 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: WARNING keystonemiddleware.auth_token [None req-1e733090-2f8e-46b4-ae08-759ce22104ab None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 17 03:03:18.389609 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: WARNING keystonemiddleware.auth_token [None req-1e733090-2f8e-46b4-ae08-759ce22104ab None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 17 03:03:18.392197 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: WARNING keystonemiddleware.auth_token [None req-15c68653-d118-43a1-9fe9-71e2311c678d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 17 03:03:18.395070 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c9cbb359c0 pid: 103856 (default app) Oct 17 03:03:18.397114 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi [None req-1e733090-2f8e-46b4-ae08-759ce22104ab None None] Calling method '>' {{(pid=103856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:03:18.398271 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: INFO nova.api.openstack.requestlog [None req-1e733090-2f8e-46b4-ae08-759ce22104ab None None] 10.222.0.27 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001692 Oct 17 03:03:18.398377 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: WARNING keystonemiddleware.auth_token [None req-15c68653-d118-43a1-9fe9-71e2311c678d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 17 03:03:18.398674 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: [pid: 103856|app: 0|req: 1/1] 10.222.0.27 () {50 vars in 788 bytes} [Mon Oct 17 03:03:18 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:03:18.403968 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c9cbb359c0 pid: 103855 (default app) Oct 17 03:04:39.740369 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi [None req-1e733090-2f8e-46b4-ae08-759ce22104ab None None] Calling method '>' {{(pid=103856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:04:39.741294 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: INFO nova.api.openstack.requestlog [None req-1e733090-2f8e-46b4-ae08-759ce22104ab None None] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Oct 17 03:04:39.741679 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: [pid: 103856|app: 0|req: 2/2] 10.222.0.27 () {54 vars in 931 bytes} [Mon Oct 17 03:04:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:04:39.754640 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG dbcounter [-] [103855] Writing DB stats nova_api:SELECT=3 {{(pid=103855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:04:39.756356 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG dbcounter [-] [103855] Writing DB stats nova_cell1:SELECT=3 {{(pid=103855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:04:39.756607 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG dbcounter [-] [103855] Writing DB stats nova_cell0:SELECT=3 {{(pid=103855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:04:39.758988 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG dbcounter [-] [103855] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:04:40.632715 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi [None req-976fccf0-b944-436f-9f2b-c7ff31fc270e admin admin] Calling method '>' {{(pid=103855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:04:40.667949 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: INFO nova.api.openstack.requestlog [None req-976fccf0-b944-436f-9f2b-c7ff31fc270e admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.919502 Oct 17 03:04:40.668712 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: [pid: 103855|app: 0|req: 1/3] 10.222.0.27 () {60 vars in 1292 bytes} [Mon Oct 17 03:04:39 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:04:43.274344 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi [None req-1e733090-2f8e-46b4-ae08-759ce22104ab None None] Calling method '>' {{(pid=103856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:04:43.275329 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: INFO nova.api.openstack.requestlog [None req-1e733090-2f8e-46b4-ae08-759ce22104ab None None] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Oct 17 03:04:43.280873 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: [pid: 103856|app: 0|req: 3/4] 10.222.0.27 () {54 vars in 931 bytes} [Mon Oct 17 03:04:43 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:04:43.730725 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi [None req-eb0eebc7-5e43-46e3-937a-482a84eb4960 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "swap": 0, "rxtx_factor": 1.0, "ram": 256, "id": "c1", "name": "cirros256", "disk": 1, "os-flavor-access:is_public": true}} {{(pid=103855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:04:43.780065 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: INFO nova.api.openstack.requestlog [None req-eb0eebc7-5e43-46e3-937a-482a84eb4960 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.496065 Oct 17 03:04:43.780634 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: [pid: 103855|app: 0|req: 2/5] 10.222.0.27 () {64 vars in 1283 bytes} [Mon Oct 17 03:04:43 2022] POST /compute/v2.1/flavors => generated 407 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 03:04:43.795045 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG dbcounter [-] [103856] Writing DB stats nova_api:SELECT=3 {{(pid=103856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:04:43.795858 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG dbcounter [-] [103856] Writing DB stats nova_cell0:SELECT=3 {{(pid=103856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:04:43.797967 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG dbcounter [-] [103856] Writing DB stats nova_cell1:SELECT=3 {{(pid=103856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:04:43.798745 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG dbcounter [-] [103856] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:04:44.005685 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi [None req-c77e281a-41c9-4a67-9a49-410655362f16 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:04:44.074778 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: INFO nova.api.openstack.requestlog [None req-c77e281a-41c9-4a67-9a49-410655362f16 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.284872 Oct 17 03:04:44.075421 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: [pid: 103856|app: 0|req: 4/6] 10.222.0.27 () {64 vars in 1336 bytes} [Mon Oct 17 03:04:43 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:04:46.709481 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi [None req-eb0eebc7-5e43-46e3-937a-482a84eb4960 admin admin] Calling method '>' {{(pid=103855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:04:46.711126 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: INFO nova.api.openstack.requestlog [None req-eb0eebc7-5e43-46e3-937a-482a84eb4960 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002032 Oct 17 03:04:46.711666 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: [pid: 103855|app: 0|req: 3/7] 10.222.0.27 () {54 vars in 931 bytes} [Mon Oct 17 03:04:46 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:04:47.369933 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi [None req-a1af47e1-54af-4516-81f7-12615e54854e admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 5, "ram": 512, "rxtx_factor": 1.0, "name": "ds512M", "id": "d1", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "os-flavor-access:is_public": true, "swap": 0}} {{(pid=103856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:04:47.411631 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: INFO nova.api.openstack.requestlog [None req-a1af47e1-54af-4516-81f7-12615e54854e admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.693788 Oct 17 03:04:47.412610 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: [pid: 103856|app: 0|req: 5/8] 10.222.0.27 () {64 vars in 1283 bytes} [Mon Oct 17 03:04:46 2022] POST /compute/v2.1/flavors => generated 404 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 03:04:47.424515 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi [None req-ac623756-76a6-4261-92e2-7caed12c3955 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:04:47.463509 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: INFO nova.api.openstack.requestlog [None req-ac623756-76a6-4261-92e2-7caed12c3955 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.042657 Oct 17 03:04:47.464470 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: [pid: 103855|app: 0|req: 4/9] 10.222.0.27 () {64 vars in 1336 bytes} [Mon Oct 17 03:04:47 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:04:50.093887 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi [None req-a1af47e1-54af-4516-81f7-12615e54854e admin admin] Calling method '>' {{(pid=103856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:04:50.094935 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: INFO nova.api.openstack.requestlog [None req-a1af47e1-54af-4516-81f7-12615e54854e admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001515 Oct 17 03:04:50.095372 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: [pid: 103856|app: 0|req: 6/10] 10.222.0.27 () {54 vars in 931 bytes} [Mon Oct 17 03:04:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:04:50.507846 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi [None req-4cb91014-babd-4c27-a1b1-d2627f4af9a9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "ds1G", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "id": "d2", "rxtx_factor": 1.0, "ram": 1024, "disk": 10, "swap": 0}} {{(pid=103855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:04:50.527904 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: INFO nova.api.openstack.requestlog [None req-4cb91014-babd-4c27-a1b1-d2627f4af9a9 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.425823 Oct 17 03:04:50.528463 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: [pid: 103855|app: 0|req: 5/11] 10.222.0.27 () {64 vars in 1283 bytes} [Mon Oct 17 03:04:50 2022] POST /compute/v2.1/flavors => generated 404 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 03:04:50.541642 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi [None req-01adf314-8aac-44e5-8f72-0ea678eba61a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:04:50.570461 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: INFO nova.api.openstack.requestlog [None req-01adf314-8aac-44e5-8f72-0ea678eba61a admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032484 Oct 17 03:04:50.571379 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: [pid: 103856|app: 0|req: 7/12] 10.222.0.27 () {64 vars in 1336 bytes} [Mon Oct 17 03:04:50 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:04:53.224131 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi [None req-4cb91014-babd-4c27-a1b1-d2627f4af9a9 admin admin] Calling method '>' {{(pid=103855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:04:53.225138 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: INFO nova.api.openstack.requestlog [None req-4cb91014-babd-4c27-a1b1-d2627f4af9a9 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001429 Oct 17 03:04:53.225532 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: [pid: 103855|app: 0|req: 6/13] 10.222.0.27 () {54 vars in 931 bytes} [Mon Oct 17 03:04:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:04:53.638022 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi [None req-1632815d-a0d2-451c-a3e9-54311503bc66 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "id": "d3", "name": "ds2G", "ram": 2048, "os-flavor-access:is_public": true, "vcpus": 2}} {{(pid=103856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:04:53.657161 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: INFO nova.api.openstack.requestlog [None req-1632815d-a0d2-451c-a3e9-54311503bc66 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.425615 Oct 17 03:04:53.665503 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: [pid: 103856|app: 0|req: 8/14] 10.222.0.27 () {64 vars in 1283 bytes} [Mon Oct 17 03:04:53 2022] POST /compute/v2.1/flavors => generated 404 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 03:04:53.670851 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi [None req-9cf678f5-a9a5-4267-be13-61817803171e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:04:53.697714 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: INFO nova.api.openstack.requestlog [None req-9cf678f5-a9a5-4267-be13-61817803171e admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030838 Oct 17 03:04:53.698435 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: [pid: 103855|app: 0|req: 7/15] 10.222.0.27 () {64 vars in 1336 bytes} [Mon Oct 17 03:04:53 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:04:56.341811 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi [None req-1632815d-a0d2-451c-a3e9-54311503bc66 admin admin] Calling method '>' {{(pid=103856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:04:56.343170 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: INFO nova.api.openstack.requestlog [None req-1632815d-a0d2-451c-a3e9-54311503bc66 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002342 Oct 17 03:04:56.343824 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: [pid: 103856|app: 0|req: 9/16] 10.222.0.27 () {54 vars in 931 bytes} [Mon Oct 17 03:04:56 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:04:56.761972 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi [None req-faa7a641-fa0b-439d-9c2e-26755d0945de admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds4G", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 4096, "swap": 0, "id": "d4"}} {{(pid=103855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:04:56.786191 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: INFO nova.api.openstack.requestlog [None req-faa7a641-fa0b-439d-9c2e-26755d0945de admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.435775 Oct 17 03:04:56.786949 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: [pid: 103855|app: 0|req: 8/17] 10.222.0.27 () {64 vars in 1283 bytes} [Mon Oct 17 03:04:56 2022] POST /compute/v2.1/flavors => generated 404 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 03:04:56.801035 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi [None req-cc2a53d1-612f-482c-aff1-458fc5d35368 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:04:56.828997 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: INFO nova.api.openstack.requestlog [None req-cc2a53d1-612f-482c-aff1-458fc5d35368 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033471 Oct 17 03:04:56.829582 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: [pid: 103856|app: 0|req: 10/18] 10.222.0.27 () {64 vars in 1336 bytes} [Mon Oct 17 03:04:56 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:04:59.992036 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi [None req-faa7a641-fa0b-439d-9c2e-26755d0945de admin admin] Calling method '>' {{(pid=103855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:04:59.993772 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: INFO nova.api.openstack.requestlog [None req-faa7a641-fa0b-439d-9c2e-26755d0945de admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002128 Oct 17 03:04:59.994356 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: [pid: 103855|app: 0|req: 9/19] 10.222.0.27 () {54 vars in 931 bytes} [Mon Oct 17 03:04:59 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:05:00.417676 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi [None req-50e72ad8-094e-4032-b919-1578306255b3 admin admin] Calling method '>' {{(pid=103856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:05:00.453393 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: INFO nova.api.openstack.requestlog [None req-50e72ad8-094e-4032-b919-1578306255b3 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.452458 Oct 17 03:05:00.454097 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: [pid: 103856|app: 0|req: 11/20] 10.222.0.27 () {60 vars in 1292 bytes} [Mon Oct 17 03:04:59 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:05:03.452996 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi [None req-faa7a641-fa0b-439d-9c2e-26755d0945de admin admin] Calling method '>' {{(pid=103855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:05:03.454014 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: INFO nova.api.openstack.requestlog [None req-faa7a641-fa0b-439d-9c2e-26755d0945de admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Oct 17 03:05:03.454531 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: [pid: 103855|app: 0|req: 10/21] 10.222.0.27 () {54 vars in 931 bytes} [Mon Oct 17 03:05:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:05:03.849607 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi [None req-c95600ca-62bb-4c89-ae49-1bf23f2b89fb admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "vcpus": 1, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "ram": 512, "swap": 0, "disk": 1, "id": "1", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:05:03.870397 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: INFO nova.api.openstack.requestlog [None req-c95600ca-62bb-4c89-ae49-1bf23f2b89fb admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.409781 Oct 17 03:05:03.870969 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: [pid: 103856|app: 0|req: 12/22] 10.222.0.27 () {64 vars in 1283 bytes} [Mon Oct 17 03:05:03 2022] POST /compute/v2.1/flavors => generated 402 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 03:05:03.882968 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi [None req-741b8449-57c9-4cda-b2b7-6f00f85b485f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:05:03.911713 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: INFO nova.api.openstack.requestlog [None req-741b8449-57c9-4cda-b2b7-6f00f85b485f admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032341 Oct 17 03:05:03.912294 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: [pid: 103855|app: 0|req: 11/23] 10.222.0.27 () {64 vars in 1333 bytes} [Mon Oct 17 03:05:03 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:05:06.530125 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi [None req-c95600ca-62bb-4c89-ae49-1bf23f2b89fb admin admin] Calling method '>' {{(pid=103856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:05:06.531154 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: INFO nova.api.openstack.requestlog [None req-c95600ca-62bb-4c89-ae49-1bf23f2b89fb admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001417 Oct 17 03:05:06.531543 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: [pid: 103856|app: 0|req: 13/24] 10.222.0.27 () {54 vars in 931 bytes} [Mon Oct 17 03:05:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:05:06.915245 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi [None req-92f0a389-29bf-4d20-b8cd-4dde7678bb4f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "disk": 20, "ram": 2048, "rxtx_factor": 1.0, "vcpus": 1, "swap": 0, "id": "2", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=103855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:05:06.938584 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: INFO nova.api.openstack.requestlog [None req-92f0a389-29bf-4d20-b8cd-4dde7678bb4f admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.400871 Oct 17 03:05:06.949473 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: [pid: 103855|app: 0|req: 12/25] 10.222.0.27 () {64 vars in 1283 bytes} [Mon Oct 17 03:05:06 2022] POST /compute/v2.1/flavors => generated 405 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 03:05:06.953027 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi [None req-bb28fa13-56f3-48b2-8cfe-16feddcef6dc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:05:06.977902 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: INFO nova.api.openstack.requestlog [None req-bb28fa13-56f3-48b2-8cfe-16feddcef6dc admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029241 Oct 17 03:05:06.979133 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: [pid: 103856|app: 0|req: 14/26] 10.222.0.27 () {64 vars in 1333 bytes} [Mon Oct 17 03:05:06 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:05:09.595678 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi [None req-92f0a389-29bf-4d20-b8cd-4dde7678bb4f admin admin] Calling method '>' {{(pid=103855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:05:09.596701 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: INFO nova.api.openstack.requestlog [None req-92f0a389-29bf-4d20-b8cd-4dde7678bb4f admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002181 Oct 17 03:05:09.597149 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: [pid: 103855|app: 0|req: 13/27] 10.222.0.27 () {54 vars in 931 bytes} [Mon Oct 17 03:05:09 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:05:10.165343 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi [None req-59e2e394-7f43-477e-a1ed-4c2fe5473f72 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "swap": 0, "ram": 4096, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 2, "id": "3", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.medium"}} {{(pid=103856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:05:10.187694 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: INFO nova.api.openstack.requestlog [None req-59e2e394-7f43-477e-a1ed-4c2fe5473f72 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.584003 Oct 17 03:05:10.188243 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: [pid: 103856|app: 0|req: 15/28] 10.222.0.27 () {64 vars in 1283 bytes} [Mon Oct 17 03:05:09 2022] POST /compute/v2.1/flavors => generated 406 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 03:05:10.200612 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi [None req-1167d12f-c264-4bba-9b4e-535d25de3288 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:05:10.207258 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG dbcounter [-] [103855] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=103855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:05:10.241041 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: INFO nova.api.openstack.requestlog [None req-1167d12f-c264-4bba-9b4e-535d25de3288 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.044008 Oct 17 03:05:10.241629 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: [pid: 103855|app: 0|req: 14/29] 10.222.0.27 () {64 vars in 1333 bytes} [Mon Oct 17 03:05:10 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:05:12.902786 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi [None req-59e2e394-7f43-477e-a1ed-4c2fe5473f72 admin admin] Calling method '>' {{(pid=103856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:05:12.904668 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: INFO nova.api.openstack.requestlog [None req-59e2e394-7f43-477e-a1ed-4c2fe5473f72 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002432 Oct 17 03:05:12.905410 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: [pid: 103856|app: 0|req: 16/30] 10.222.0.27 () {54 vars in 931 bytes} [Mon Oct 17 03:05:12 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:05:13.359957 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi [None req-fd96aa6a-841b-47d1-9d50-b60eb6559689 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "4", "rxtx_factor": 1.0, "swap": 0, "ram": 8192, "vcpus": 4, "name": "m1.large", "os-flavor-access:is_public": true, "disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:05:13.380642 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: INFO nova.api.openstack.requestlog [None req-fd96aa6a-841b-47d1-9d50-b60eb6559689 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.467739 Oct 17 03:05:13.381180 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: [pid: 103855|app: 0|req: 15/31] 10.222.0.27 () {64 vars in 1283 bytes} [Mon Oct 17 03:05:12 2022] POST /compute/v2.1/flavors => generated 405 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 17 03:05:13.393466 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi [None req-a2e31808-c776-4fab-94f5-292c8154be04 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:05:13.418276 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: INFO nova.api.openstack.requestlog [None req-a2e31808-c776-4fab-94f5-292c8154be04 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028814 Oct 17 03:05:13.419119 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: [pid: 103856|app: 0|req: 17/32] 10.222.0.27 () {64 vars in 1333 bytes} [Mon Oct 17 03:05:13 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:05:16.083853 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi [None req-fd96aa6a-841b-47d1-9d50-b60eb6559689 admin admin] Calling method '>' {{(pid=103855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:05:16.085534 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: INFO nova.api.openstack.requestlog [None req-fd96aa6a-841b-47d1-9d50-b60eb6559689 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002099 Oct 17 03:05:16.085927 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: [pid: 103855|app: 0|req: 16/33] 10.222.0.27 () {54 vars in 931 bytes} [Mon Oct 17 03:05:16 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:05:16.533624 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi [None req-a00eb2c7-1361-4b1f-a487-87f6a62b1b19 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 16384, "vcpus": 8, "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "5", "name": "m1.xlarge", "disk": 160}} {{(pid=103856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:05:16.541771 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG dbcounter [-] [103856] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=103856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:05:16.557101 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: INFO nova.api.openstack.requestlog [None req-a00eb2c7-1361-4b1f-a487-87f6a62b1b19 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.465022 Oct 17 03:05:16.557764 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: [pid: 103856|app: 0|req: 18/34] 10.222.0.27 () {64 vars in 1283 bytes} [Mon Oct 17 03:05:16 2022] POST /compute/v2.1/flavors => generated 408 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 17 03:05:16.572943 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi [None req-456ddd7d-a7eb-4248-bd50-1c9434861c54 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:05:16.600024 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: INFO nova.api.openstack.requestlog [None req-456ddd7d-a7eb-4248-bd50-1c9434861c54 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033458 Oct 17 03:05:16.614896 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: [pid: 103855|app: 0|req: 17/35] 10.222.0.27 () {64 vars in 1333 bytes} [Mon Oct 17 03:05:16 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:05:32.960056 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi [None req-a00eb2c7-1361-4b1f-a487-87f6a62b1b19 admin admin] Calling method '>' {{(pid=103856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:05:32.960986 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: INFO nova.api.openstack.requestlog [None req-a00eb2c7-1361-4b1f-a487-87f6a62b1b19 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Oct 17 03:05:32.961378 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: [pid: 103856|app: 0|req: 19/36] 10.222.0.27 () {54 vars in 931 bytes} [Mon Oct 17 03:05:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:05:32.972323 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG dbcounter [-] [103855] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=103855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:05:33.350025 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi [None req-a3bf80e2-f2ef-44f8-bcc2-84cb3d6a39bd admin admin] Calling method '>' {{(pid=103855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:05:33.367885 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: INFO nova.api.openstack.requestlog [None req-a3bf80e2-f2ef-44f8-bcc2-84cb3d6a39bd admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.400532 Oct 17 03:05:33.368416 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: [pid: 103855|app: 0|req: 18/37] 10.222.0.27 () {60 vars in 1292 bytes} [Mon Oct 17 03:05:32 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 03:05:34.672620 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi [None req-a00eb2c7-1361-4b1f-a487-87f6a62b1b19 admin admin] Calling method '>' {{(pid=103856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:05:34.673811 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: INFO nova.api.openstack.requestlog [None req-a00eb2c7-1361-4b1f-a487-87f6a62b1b19 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001654 Oct 17 03:05:34.674204 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: [pid: 103856|app: 0|req: 20/38] 10.222.0.27 () {56 vars in 1074 bytes} [Mon Oct 17 03:05:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:05:35.193643 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi [None req-d9c3f7ab-c766-46de-9ed3-d5cbacfa55d2 admin admin] Calling method '>' {{(pid=103855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:05:35.198891 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: INFO nova.api.openstack.wsgi [None req-d9c3f7ab-c766-46de-9ed3-d5cbacfa55d2 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 17 03:05:35.202057 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi [None req-d9c3f7ab-c766-46de-9ed3-d5cbacfa55d2 admin admin] Request method failure captured: Oct 17 03:05:35.202057 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 17 03:05:35.202057 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: Accept: application/json Oct 17 03:05:35.202057 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: Accept-Encoding: gzip, deflate Oct 17 03:05:35.202057 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: Connection: keep-alive Oct 17 03:05:35.202057 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: Content-Length: 0 Oct 17 03:05:35.202057 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: Host: 10.222.0.27 Oct 17 03:05:35.202057 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: Openstack-Api-Version: compute 2.92 Oct 17 03:05:35.202057 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: Openstack-System-Scope: None Oct 17 03:05:35.202057 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: User-Agent: python-novaclient Oct 17 03:05:35.202057 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: X-Auth-Token: gAAAAABjTMZ-G-vQakAflOMPs68bUPmmZ6e6x7OpVIXdWJSnx6A9XTWGLzmKr93-YU4We0mMWsunK-I4kEFYaJ3Epsr6xGRgarCQaExyX5OR7ZmcJOJRBWOiOmSTLxrkHXJ2T2wjW5usuCdMzqZEFrhDcxyc40bB5mQ49_R_fTOMT3ji7m6GPMY Oct 17 03:05:35.202057 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: X-Domain-Id: None Oct 17 03:05:35.202057 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: X-Domain-Name: None Oct 17 03:05:35.202057 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: X-Identity-Status: Confirmed Oct 17 03:05:35.202057 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: X-Is-Admin-Project: True Oct 17 03:05:35.202057 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: X-Openstack-Nova-Api-Version: 2.92 Oct 17 03:05:35.202057 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: X-Project-Domain-Id: default Oct 17 03:05:35.202057 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: X-Project-Domain-Name: Default Oct 17 03:05:35.202057 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: X-Project-Id: eb6be797d9e4443fad02ceee69bd83a7 Oct 17 03:05:35.202057 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: X-Project-Name: admin Oct 17 03:05:35.202057 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: X-Role: admin,member,reader Oct 17 03:05:35.202057 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: X-Roles: admin,member,reader Oct 17 03:05:35.204329 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/eb6be797d9e4443fad02ceee69bd83a7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/eb6be797d9e4443fad02ceee69bd83a7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/eb6be797d9e4443fad02ceee69bd83a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_eb6be797d9e4443fad02ceee69bd83a7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 17 03:05:35.204329 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: X-Tenant: admin Oct 17 03:05:35.204329 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: X-Tenant-Id: eb6be797d9e4443fad02ceee69bd83a7 Oct 17 03:05:35.204329 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: X-Tenant-Name: admin Oct 17 03:05:35.204329 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: X-User: admin Oct 17 03:05:35.204329 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: X-User-Domain-Id: default Oct 17 03:05:35.204329 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: X-User-Domain-Name: Default Oct 17 03:05:35.204329 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: X-User-Id: f84d693b9d0643c69861a5541952b43b Oct 17 03:05:35.204329 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: X-User-Name: admin Oct 17 03:05:35.204329 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: method: > Oct 17 03:05:35.204329 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: exception: Flavor 42 could not be found. Oct 17 03:05:35.204329 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: action_args: {'id': '42'} Oct 17 03:05:35.204329 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: {{(pid=103855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 03:05:35.204329 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:05:35.205279 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 17 03:05:35.205279 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 17 03:05:35.205279 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 17 03:05:35.205279 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 17 03:05:35.205279 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 03:05:35.205279 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 03:05:35.205279 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 17 03:05:35.205279 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 17 03:05:35.205279 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 17 03:05:35.205279 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 03:05:35.205279 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 17 03:05:35.205279 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 17 03:05:35.205279 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 17 03:05:35.205279 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: ERROR nova.api.openstack.wsgi Oct 17 03:05:35.205279 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:05:35.205279 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: ERROR nova.api.openstack.wsgi Oct 17 03:05:35.205279 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:05:35.205279 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:05:35.205279 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:05:35.206356 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 03:05:35.206356 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 03:05:35.206356 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 03:05:35.206356 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 03:05:35.206356 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 17 03:05:35.206356 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 17 03:05:35.206356 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 17 03:05:35.206356 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: ERROR nova.api.openstack.wsgi Oct 17 03:05:35.206356 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:05:35.206356 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: ERROR nova.api.openstack.wsgi Oct 17 03:05:35.206356 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:05:35.206356 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:05:35.206356 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:05:35.206356 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 03:05:35.206356 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 03:05:35.206356 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 17 03:05:35.206356 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: ERROR nova.api.openstack.wsgi Oct 17 03:05:35.206356 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi [None req-d9c3f7ab-c766-46de-9ed3-d5cbacfa55d2 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103855) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 03:05:35.207421 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: INFO nova.api.openstack.requestlog [None req-d9c3f7ab-c766-46de-9ed3-d5cbacfa55d2 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.393464 Oct 17 03:05:35.207421 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: [pid: 103855|app: 0|req: 19/39] 10.222.0.27 () {60 vars in 1190 bytes} [Mon Oct 17 03:05:34 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 395 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 17 03:05:35.213860 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi [None req-e5b86627-bbe3-47c1-9822-e3730522164d admin admin] Calling method '>' {{(pid=103856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:05:35.237817 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: INFO nova.api.openstack.requestlog [None req-e5b86627-bbe3-47c1-9822-e3730522164d admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027420 Oct 17 03:05:35.238380 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: [pid: 103856|app: 0|req: 21/40] 10.222.0.27 () {60 vars in 1210 bytes} [Mon Oct 17 03:05:35 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:05:35.249141 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi [None req-8ebce0f0-9044-4fe0-a36a-3a571a0312d0 admin admin] Calling method '>' {{(pid=103855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:05:35.271383 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: INFO nova.api.openstack.requestlog [None req-8ebce0f0-9044-4fe0-a36a-3a571a0312d0 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026721 Oct 17 03:05:35.271930 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: [pid: 103855|app: 0|req: 20/41] 10.222.0.27 () {60 vars in 1210 bytes} [Mon Oct 17 03:05:35 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:05:35.281673 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi [None req-b3332804-2951-4bb7-8d41-f13f551af1ec admin admin] Calling method '>' {{(pid=103856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:05:35.287587 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: INFO nova.api.openstack.wsgi [None req-b3332804-2951-4bb7-8d41-f13f551af1ec admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 17 03:05:35.291055 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi [None req-b3332804-2951-4bb7-8d41-f13f551af1ec admin admin] Request method failure captured: Oct 17 03:05:35.291055 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 17 03:05:35.291055 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: Accept: application/json Oct 17 03:05:35.291055 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: Accept-Encoding: gzip, deflate Oct 17 03:05:35.291055 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: Connection: keep-alive Oct 17 03:05:35.291055 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: Content-Length: 0 Oct 17 03:05:35.291055 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: Host: 10.222.0.27 Oct 17 03:05:35.291055 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: Openstack-Api-Version: compute 2.92 Oct 17 03:05:35.291055 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: Openstack-System-Scope: None Oct 17 03:05:35.291055 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: User-Agent: python-novaclient Oct 17 03:05:35.291055 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: X-Auth-Token: gAAAAABjTMZ-G-vQakAflOMPs68bUPmmZ6e6x7OpVIXdWJSnx6A9XTWGLzmKr93-YU4We0mMWsunK-I4kEFYaJ3Epsr6xGRgarCQaExyX5OR7ZmcJOJRBWOiOmSTLxrkHXJ2T2wjW5usuCdMzqZEFrhDcxyc40bB5mQ49_R_fTOMT3ji7m6GPMY Oct 17 03:05:35.291055 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: X-Domain-Id: None Oct 17 03:05:35.291055 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: X-Domain-Name: None Oct 17 03:05:35.291055 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: X-Identity-Status: Confirmed Oct 17 03:05:35.291055 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: X-Is-Admin-Project: True Oct 17 03:05:35.291055 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: X-Openstack-Nova-Api-Version: 2.92 Oct 17 03:05:35.291055 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: X-Project-Domain-Id: default Oct 17 03:05:35.291055 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: X-Project-Domain-Name: Default Oct 17 03:05:35.291055 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: X-Project-Id: eb6be797d9e4443fad02ceee69bd83a7 Oct 17 03:05:35.291055 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: X-Project-Name: admin Oct 17 03:05:35.291055 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: X-Role: admin,member,reader Oct 17 03:05:35.291055 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: X-Roles: admin,member,reader Oct 17 03:05:35.292372 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/eb6be797d9e4443fad02ceee69bd83a7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/eb6be797d9e4443fad02ceee69bd83a7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/eb6be797d9e4443fad02ceee69bd83a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_eb6be797d9e4443fad02ceee69bd83a7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 17 03:05:35.292372 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: X-Tenant: admin Oct 17 03:05:35.292372 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: X-Tenant-Id: eb6be797d9e4443fad02ceee69bd83a7 Oct 17 03:05:35.292372 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: X-Tenant-Name: admin Oct 17 03:05:35.292372 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: X-User: admin Oct 17 03:05:35.292372 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: X-User-Domain-Id: default Oct 17 03:05:35.292372 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: X-User-Domain-Name: Default Oct 17 03:05:35.292372 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: X-User-Id: f84d693b9d0643c69861a5541952b43b Oct 17 03:05:35.292372 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: X-User-Name: admin Oct 17 03:05:35.292372 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: method: > Oct 17 03:05:35.292372 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: exception: Flavor 42 could not be found. Oct 17 03:05:35.292372 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: action_args: {'id': '42'} Oct 17 03:05:35.292372 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: {{(pid=103856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 03:05:35.292372 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:05:35.293351 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 17 03:05:35.293351 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 17 03:05:35.293351 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 17 03:05:35.293351 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 17 03:05:35.293351 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 03:05:35.293351 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 03:05:35.293351 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 17 03:05:35.293351 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 17 03:05:35.293351 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 17 03:05:35.293351 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 03:05:35.293351 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 17 03:05:35.293351 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 17 03:05:35.293351 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 17 03:05:35.293351 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: ERROR nova.api.openstack.wsgi Oct 17 03:05:35.293351 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:05:35.293351 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: ERROR nova.api.openstack.wsgi Oct 17 03:05:35.293351 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:05:35.293351 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:05:35.293351 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:05:35.294770 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 03:05:35.294770 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 03:05:35.294770 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 03:05:35.294770 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 03:05:35.294770 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 17 03:05:35.294770 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 17 03:05:35.294770 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 17 03:05:35.294770 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: ERROR nova.api.openstack.wsgi Oct 17 03:05:35.294770 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:05:35.294770 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: ERROR nova.api.openstack.wsgi Oct 17 03:05:35.294770 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:05:35.294770 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:05:35.294770 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:05:35.294770 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 03:05:35.294770 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 03:05:35.294770 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 17 03:05:35.294770 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: ERROR nova.api.openstack.wsgi Oct 17 03:05:35.294770 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi [None req-b3332804-2951-4bb7-8d41-f13f551af1ec admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103856) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 03:05:35.296103 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: INFO nova.api.openstack.requestlog [None req-b3332804-2951-4bb7-8d41-f13f551af1ec admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.014744 Oct 17 03:05:35.296103 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: [pid: 103856|app: 0|req: 22/42] 10.222.0.27 () {60 vars in 1190 bytes} [Mon Oct 17 03:05:35 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Oct 17 03:05:36.512679 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi [None req-8ebce0f0-9044-4fe0-a36a-3a571a0312d0 admin admin] Calling method '>' {{(pid=103855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:05:36.513702 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: INFO nova.api.openstack.requestlog [None req-8ebce0f0-9044-4fe0-a36a-3a571a0312d0 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Oct 17 03:05:36.514105 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: [pid: 103855|app: 0|req: 21/43] 10.222.0.27 () {56 vars in 1074 bytes} [Mon Oct 17 03:05:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:05:37.028796 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi [None req-5237c845-d1ca-4db8-80e2-5162d46ecb6e admin admin] Calling method '>' {{(pid=103856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:05:37.034423 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: INFO nova.api.openstack.wsgi [None req-5237c845-d1ca-4db8-80e2-5162d46ecb6e admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 17 03:05:37.035941 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi [None req-5237c845-d1ca-4db8-80e2-5162d46ecb6e admin admin] Request method failure captured: Oct 17 03:05:37.035941 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 17 03:05:37.035941 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: Accept: application/json Oct 17 03:05:37.035941 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: Accept-Encoding: gzip, deflate Oct 17 03:05:37.035941 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: Connection: keep-alive Oct 17 03:05:37.035941 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: Content-Length: 0 Oct 17 03:05:37.035941 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: Host: 10.222.0.27 Oct 17 03:05:37.035941 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: Openstack-Api-Version: compute 2.92 Oct 17 03:05:37.035941 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: Openstack-System-Scope: None Oct 17 03:05:37.035941 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: User-Agent: python-novaclient Oct 17 03:05:37.035941 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: X-Auth-Token: gAAAAABjTMaAAEVqS-t43pA4uSw-x0KqcSlr2XjjXyrFAl97XNEbPE0GaOa5OUsKjPOYQ2TJGzaFFFe-22xHfKMV7cJ5He9M0E-I7DIDOv33AIOBkI7ctBRcNEfuZh71eDKJuwm9JlwELz9zHFdJdeVKaNV1-GVFGgNGFMJ2088VWmNEuCGAi7Y Oct 17 03:05:37.035941 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: X-Domain-Id: None Oct 17 03:05:37.035941 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: X-Domain-Name: None Oct 17 03:05:37.035941 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: X-Identity-Status: Confirmed Oct 17 03:05:37.035941 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: X-Is-Admin-Project: True Oct 17 03:05:37.035941 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: X-Openstack-Nova-Api-Version: 2.92 Oct 17 03:05:37.035941 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: X-Project-Domain-Id: default Oct 17 03:05:37.035941 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: X-Project-Domain-Name: Default Oct 17 03:05:37.035941 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: X-Project-Id: eb6be797d9e4443fad02ceee69bd83a7 Oct 17 03:05:37.035941 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: X-Project-Name: admin Oct 17 03:05:37.035941 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: X-Role: admin,member,reader Oct 17 03:05:37.035941 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: X-Roles: admin,member,reader Oct 17 03:05:37.037527 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/eb6be797d9e4443fad02ceee69bd83a7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/eb6be797d9e4443fad02ceee69bd83a7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/eb6be797d9e4443fad02ceee69bd83a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_eb6be797d9e4443fad02ceee69bd83a7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 17 03:05:37.037527 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: X-Tenant: admin Oct 17 03:05:37.037527 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: X-Tenant-Id: eb6be797d9e4443fad02ceee69bd83a7 Oct 17 03:05:37.037527 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: X-Tenant-Name: admin Oct 17 03:05:37.037527 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: X-User: admin Oct 17 03:05:37.037527 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: X-User-Domain-Id: default Oct 17 03:05:37.037527 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: X-User-Domain-Name: Default Oct 17 03:05:37.037527 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: X-User-Id: f84d693b9d0643c69861a5541952b43b Oct 17 03:05:37.037527 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: X-User-Name: admin Oct 17 03:05:37.037527 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: method: > Oct 17 03:05:37.037527 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: exception: Flavor 84 could not be found. Oct 17 03:05:37.037527 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: action_args: {'id': '84'} Oct 17 03:05:37.037527 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: {{(pid=103856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 03:05:37.037527 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:05:37.038585 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 17 03:05:37.038585 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 17 03:05:37.038585 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 17 03:05:37.038585 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 17 03:05:37.038585 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 03:05:37.038585 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 03:05:37.038585 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 17 03:05:37.038585 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 17 03:05:37.038585 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 17 03:05:37.038585 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 03:05:37.038585 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 17 03:05:37.038585 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 17 03:05:37.038585 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 17 03:05:37.038585 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: ERROR nova.api.openstack.wsgi Oct 17 03:05:37.038585 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:05:37.038585 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: ERROR nova.api.openstack.wsgi Oct 17 03:05:37.038585 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:05:37.038585 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:05:37.038585 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:05:37.039969 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 03:05:37.039969 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 03:05:37.039969 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 03:05:37.039969 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 03:05:37.039969 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 17 03:05:37.039969 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 17 03:05:37.039969 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 17 03:05:37.039969 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: ERROR nova.api.openstack.wsgi Oct 17 03:05:37.039969 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:05:37.039969 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: ERROR nova.api.openstack.wsgi Oct 17 03:05:37.039969 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:05:37.039969 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:05:37.039969 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:05:37.039969 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 03:05:37.039969 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 03:05:37.039969 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 17 03:05:37.039969 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: ERROR nova.api.openstack.wsgi Oct 17 03:05:37.039969 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi [None req-5237c845-d1ca-4db8-80e2-5162d46ecb6e admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103856) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 03:05:37.041193 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: INFO nova.api.openstack.requestlog [None req-5237c845-d1ca-4db8-80e2-5162d46ecb6e admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.386440 Oct 17 03:05:37.041193 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: [pid: 103856|app: 0|req: 23/44] 10.222.0.27 () {60 vars in 1190 bytes} [Mon Oct 17 03:05:36 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 387 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 17 03:05:37.047028 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi [None req-9b741a87-145e-4b82-8ac5-4dbfad843580 admin admin] Calling method '>' {{(pid=103855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:05:37.061614 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: INFO nova.api.openstack.requestlog [None req-9b741a87-145e-4b82-8ac5-4dbfad843580 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018138 Oct 17 03:05:37.062133 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: [pid: 103855|app: 0|req: 22/45] 10.222.0.27 () {60 vars in 1210 bytes} [Mon Oct 17 03:05:37 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:05:37.071623 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi [None req-0cc48dfb-b856-431e-8cfa-187c7a10e05b admin admin] Calling method '>' {{(pid=103856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:05:37.087422 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: INFO nova.api.openstack.requestlog [None req-0cc48dfb-b856-431e-8cfa-187c7a10e05b admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019232 Oct 17 03:05:37.087929 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: [pid: 103856|app: 0|req: 24/46] 10.222.0.27 () {60 vars in 1210 bytes} [Mon Oct 17 03:05:37 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 03:05:37.097129 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi [None req-0087e19d-a44c-4bf4-b8e6-ddbd37ac3c12 admin admin] Calling method '>' {{(pid=103855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:05:37.102428 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: INFO nova.api.openstack.wsgi [None req-0087e19d-a44c-4bf4-b8e6-ddbd37ac3c12 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 17 03:05:37.103995 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi [None req-0087e19d-a44c-4bf4-b8e6-ddbd37ac3c12 admin admin] Request method failure captured: Oct 17 03:05:37.103995 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 17 03:05:37.103995 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: Accept: application/json Oct 17 03:05:37.103995 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: Accept-Encoding: gzip, deflate Oct 17 03:05:37.103995 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: Connection: keep-alive Oct 17 03:05:37.103995 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: Content-Length: 0 Oct 17 03:05:37.103995 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: Host: 10.222.0.27 Oct 17 03:05:37.103995 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: Openstack-Api-Version: compute 2.92 Oct 17 03:05:37.103995 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: Openstack-System-Scope: None Oct 17 03:05:37.103995 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: User-Agent: python-novaclient Oct 17 03:05:37.103995 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: X-Auth-Token: gAAAAABjTMaAAEVqS-t43pA4uSw-x0KqcSlr2XjjXyrFAl97XNEbPE0GaOa5OUsKjPOYQ2TJGzaFFFe-22xHfKMV7cJ5He9M0E-I7DIDOv33AIOBkI7ctBRcNEfuZh71eDKJuwm9JlwELz9zHFdJdeVKaNV1-GVFGgNGFMJ2088VWmNEuCGAi7Y Oct 17 03:05:37.103995 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: X-Domain-Id: None Oct 17 03:05:37.103995 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: X-Domain-Name: None Oct 17 03:05:37.103995 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: X-Identity-Status: Confirmed Oct 17 03:05:37.103995 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: X-Is-Admin-Project: True Oct 17 03:05:37.103995 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: X-Openstack-Nova-Api-Version: 2.92 Oct 17 03:05:37.103995 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: X-Project-Domain-Id: default Oct 17 03:05:37.103995 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: X-Project-Domain-Name: Default Oct 17 03:05:37.103995 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: X-Project-Id: eb6be797d9e4443fad02ceee69bd83a7 Oct 17 03:05:37.103995 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: X-Project-Name: admin Oct 17 03:05:37.103995 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: X-Role: admin,member,reader Oct 17 03:05:37.103995 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: X-Roles: admin,member,reader Oct 17 03:05:37.105282 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/eb6be797d9e4443fad02ceee69bd83a7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/eb6be797d9e4443fad02ceee69bd83a7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/eb6be797d9e4443fad02ceee69bd83a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_eb6be797d9e4443fad02ceee69bd83a7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 17 03:05:37.105282 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: X-Tenant: admin Oct 17 03:05:37.105282 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: X-Tenant-Id: eb6be797d9e4443fad02ceee69bd83a7 Oct 17 03:05:37.105282 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: X-Tenant-Name: admin Oct 17 03:05:37.105282 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: X-User: admin Oct 17 03:05:37.105282 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: X-User-Domain-Id: default Oct 17 03:05:37.105282 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: X-User-Domain-Name: Default Oct 17 03:05:37.105282 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: X-User-Id: f84d693b9d0643c69861a5541952b43b Oct 17 03:05:37.105282 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: X-User-Name: admin Oct 17 03:05:37.105282 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: method: > Oct 17 03:05:37.105282 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: exception: Flavor 84 could not be found. Oct 17 03:05:37.105282 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: action_args: {'id': '84'} Oct 17 03:05:37.105282 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: {{(pid=103855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 03:05:37.105282 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:05:37.106210 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 17 03:05:37.106210 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 17 03:05:37.106210 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 17 03:05:37.106210 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 17 03:05:37.106210 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 03:05:37.106210 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 03:05:37.106210 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 17 03:05:37.106210 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 17 03:05:37.106210 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 17 03:05:37.106210 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 03:05:37.106210 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 17 03:05:37.106210 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 17 03:05:37.106210 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 17 03:05:37.106210 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: ERROR nova.api.openstack.wsgi Oct 17 03:05:37.106210 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:05:37.106210 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: ERROR nova.api.openstack.wsgi Oct 17 03:05:37.106210 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:05:37.106210 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:05:37.106210 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:05:37.107536 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 03:05:37.107536 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 03:05:37.107536 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 03:05:37.107536 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 03:05:37.107536 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 17 03:05:37.107536 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 17 03:05:37.107536 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 17 03:05:37.107536 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: ERROR nova.api.openstack.wsgi Oct 17 03:05:37.107536 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:05:37.107536 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: ERROR nova.api.openstack.wsgi Oct 17 03:05:37.107536 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:05:37.107536 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:05:37.107536 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:05:37.107536 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 03:05:37.107536 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 03:05:37.107536 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 17 03:05:37.107536 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: ERROR nova.api.openstack.wsgi Oct 17 03:05:37.107536 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi [None req-0087e19d-a44c-4bf4-b8e6-ddbd37ac3c12 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103855) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 03:05:37.108811 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: INFO nova.api.openstack.requestlog [None req-0087e19d-a44c-4bf4-b8e6-ddbd37ac3c12 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011829 Oct 17 03:05:37.108811 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: [pid: 103855|app: 0|req: 23/47] 10.222.0.27 () {60 vars in 1190 bytes} [Mon Oct 17 03:05:37 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Oct 17 03:05:38.333458 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi [None req-0cc48dfb-b856-431e-8cfa-187c7a10e05b admin admin] Calling method '>' {{(pid=103856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:05:38.334576 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: INFO nova.api.openstack.requestlog [None req-0cc48dfb-b856-431e-8cfa-187c7a10e05b admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 Oct 17 03:05:38.334900 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: [pid: 103856|app: 0|req: 25/48] 10.222.0.27 () {56 vars in 1074 bytes} [Mon Oct 17 03:05:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:05:38.856304 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi [None req-f955773d-04ce-44af-a396-72346984478a admin admin] Calling method '>' {{(pid=103855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:05:38.862365 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: INFO nova.api.openstack.wsgi [None req-f955773d-04ce-44af-a396-72346984478a admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 17 03:05:38.863901 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi [None req-f955773d-04ce-44af-a396-72346984478a admin admin] Request method failure captured: Oct 17 03:05:38.863901 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 17 03:05:38.863901 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: Accept: application/json Oct 17 03:05:38.863901 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: Accept-Encoding: gzip, deflate Oct 17 03:05:38.863901 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: Connection: keep-alive Oct 17 03:05:38.863901 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: Content-Length: 0 Oct 17 03:05:38.863901 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: Host: 10.222.0.27 Oct 17 03:05:38.863901 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: Openstack-Api-Version: compute 2.92 Oct 17 03:05:38.863901 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: Openstack-System-Scope: None Oct 17 03:05:38.863901 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: User-Agent: python-novaclient Oct 17 03:05:38.863901 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: X-Auth-Token: gAAAAABjTMaCUd0ticXQweI72vH2lTaONJ3Yyzi05WF50P3ohwNHp9mapjMNyo_pmHKSzNNtgsnEZbi93iyyCN_SzvRSPWfNv42swfSXI0WPF7AI4hVUEn3Q_58u6VWhmlDrlP9C_Fzx2Zic_moa6nwq7vFqgROXqc0aIv3thvxuS78-xgN4yj4 Oct 17 03:05:38.863901 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: X-Domain-Id: None Oct 17 03:05:38.863901 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: X-Domain-Name: None Oct 17 03:05:38.863901 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: X-Identity-Status: Confirmed Oct 17 03:05:38.863901 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: X-Is-Admin-Project: True Oct 17 03:05:38.863901 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: X-Openstack-Nova-Api-Version: 2.92 Oct 17 03:05:38.863901 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: X-Project-Domain-Id: default Oct 17 03:05:38.863901 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: X-Project-Domain-Name: Default Oct 17 03:05:38.863901 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: X-Project-Id: eb6be797d9e4443fad02ceee69bd83a7 Oct 17 03:05:38.863901 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: X-Project-Name: admin Oct 17 03:05:38.863901 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: X-Role: admin,member,reader Oct 17 03:05:38.863901 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: X-Roles: admin,member,reader Oct 17 03:05:38.865549 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/eb6be797d9e4443fad02ceee69bd83a7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/eb6be797d9e4443fad02ceee69bd83a7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/eb6be797d9e4443fad02ceee69bd83a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_eb6be797d9e4443fad02ceee69bd83a7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 17 03:05:38.865549 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: X-Tenant: admin Oct 17 03:05:38.865549 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: X-Tenant-Id: eb6be797d9e4443fad02ceee69bd83a7 Oct 17 03:05:38.865549 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: X-Tenant-Name: admin Oct 17 03:05:38.865549 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: X-User: admin Oct 17 03:05:38.865549 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: X-User-Domain-Id: default Oct 17 03:05:38.865549 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: X-User-Domain-Name: Default Oct 17 03:05:38.865549 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: X-User-Id: f84d693b9d0643c69861a5541952b43b Oct 17 03:05:38.865549 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: X-User-Name: admin Oct 17 03:05:38.865549 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: method: > Oct 17 03:05:38.865549 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: exception: Flavor 451 could not be found. Oct 17 03:05:38.865549 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: action_args: {'id': '451'} Oct 17 03:05:38.865549 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: {{(pid=103855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 03:05:38.865549 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:05:38.867623 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 17 03:05:38.867623 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 17 03:05:38.867623 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 17 03:05:38.867623 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 17 03:05:38.867623 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 03:05:38.867623 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 03:05:38.867623 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 17 03:05:38.867623 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 17 03:05:38.867623 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 17 03:05:38.867623 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 03:05:38.867623 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 17 03:05:38.867623 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 17 03:05:38.867623 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 17 03:05:38.867623 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: ERROR nova.api.openstack.wsgi Oct 17 03:05:38.867623 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:05:38.867623 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: ERROR nova.api.openstack.wsgi Oct 17 03:05:38.867623 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:05:38.867623 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:05:38.867623 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:05:38.869005 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 03:05:38.869005 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 03:05:38.869005 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 03:05:38.869005 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 03:05:38.869005 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 17 03:05:38.869005 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 17 03:05:38.869005 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 17 03:05:38.869005 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: ERROR nova.api.openstack.wsgi Oct 17 03:05:38.869005 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:05:38.869005 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: ERROR nova.api.openstack.wsgi Oct 17 03:05:38.869005 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:05:38.869005 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:05:38.869005 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:05:38.869005 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 03:05:38.869005 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 03:05:38.869005 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 17 03:05:38.869005 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: ERROR nova.api.openstack.wsgi Oct 17 03:05:38.869005 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi [None req-f955773d-04ce-44af-a396-72346984478a admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103855) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 03:05:38.870244 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: INFO nova.api.openstack.requestlog [None req-f955773d-04ce-44af-a396-72346984478a admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.391875 Oct 17 03:05:38.870244 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: [pid: 103855|app: 0|req: 24/49] 10.222.0.27 () {60 vars in 1193 bytes} [Mon Oct 17 03:05:38 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 393 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 17 03:05:38.875137 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi [None req-59443755-e1f5-4492-855a-00c840cf825d admin admin] Calling method '>' {{(pid=103856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:05:38.890252 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: INFO nova.api.openstack.requestlog [None req-59443755-e1f5-4492-855a-00c840cf825d admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018748 Oct 17 03:05:38.891058 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: [pid: 103856|app: 0|req: 26/50] 10.222.0.27 () {60 vars in 1210 bytes} [Mon Oct 17 03:05:38 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:05:38.901104 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi [None req-cd6465ea-abcd-4e3d-b513-e2b17c12201a admin admin] Calling method '>' {{(pid=103855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:05:38.916541 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: INFO nova.api.openstack.requestlog [None req-cd6465ea-abcd-4e3d-b513-e2b17c12201a admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018919 Oct 17 03:05:38.917079 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: [pid: 103855|app: 0|req: 25/51] 10.222.0.27 () {60 vars in 1210 bytes} [Mon Oct 17 03:05:38 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 03:05:38.927315 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi [None req-d3862c51-f2bc-4cb0-9fab-db02a5106d8a admin admin] Calling method '>' {{(pid=103856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:05:38.932277 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: INFO nova.api.openstack.wsgi [None req-d3862c51-f2bc-4cb0-9fab-db02a5106d8a admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 17 03:05:38.933756 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi [None req-d3862c51-f2bc-4cb0-9fab-db02a5106d8a admin admin] Request method failure captured: Oct 17 03:05:38.933756 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 17 03:05:38.933756 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: Accept: application/json Oct 17 03:05:38.933756 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: Accept-Encoding: gzip, deflate Oct 17 03:05:38.933756 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: Connection: keep-alive Oct 17 03:05:38.933756 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: Content-Length: 0 Oct 17 03:05:38.933756 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: Host: 10.222.0.27 Oct 17 03:05:38.933756 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: Openstack-Api-Version: compute 2.92 Oct 17 03:05:38.933756 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: Openstack-System-Scope: None Oct 17 03:05:38.933756 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: User-Agent: python-novaclient Oct 17 03:05:38.933756 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: X-Auth-Token: gAAAAABjTMaCUd0ticXQweI72vH2lTaONJ3Yyzi05WF50P3ohwNHp9mapjMNyo_pmHKSzNNtgsnEZbi93iyyCN_SzvRSPWfNv42swfSXI0WPF7AI4hVUEn3Q_58u6VWhmlDrlP9C_Fzx2Zic_moa6nwq7vFqgROXqc0aIv3thvxuS78-xgN4yj4 Oct 17 03:05:38.933756 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: X-Domain-Id: None Oct 17 03:05:38.933756 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: X-Domain-Name: None Oct 17 03:05:38.933756 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: X-Identity-Status: Confirmed Oct 17 03:05:38.933756 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: X-Is-Admin-Project: True Oct 17 03:05:38.933756 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: X-Openstack-Nova-Api-Version: 2.92 Oct 17 03:05:38.933756 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: X-Project-Domain-Id: default Oct 17 03:05:38.933756 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: X-Project-Domain-Name: Default Oct 17 03:05:38.933756 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: X-Project-Id: eb6be797d9e4443fad02ceee69bd83a7 Oct 17 03:05:38.933756 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: X-Project-Name: admin Oct 17 03:05:38.933756 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: X-Role: admin,member,reader Oct 17 03:05:38.933756 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: X-Roles: admin,member,reader Oct 17 03:05:38.935080 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/eb6be797d9e4443fad02ceee69bd83a7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/eb6be797d9e4443fad02ceee69bd83a7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/eb6be797d9e4443fad02ceee69bd83a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_eb6be797d9e4443fad02ceee69bd83a7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 17 03:05:38.935080 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: X-Tenant: admin Oct 17 03:05:38.935080 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: X-Tenant-Id: eb6be797d9e4443fad02ceee69bd83a7 Oct 17 03:05:38.935080 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: X-Tenant-Name: admin Oct 17 03:05:38.935080 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: X-User: admin Oct 17 03:05:38.935080 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: X-User-Domain-Id: default Oct 17 03:05:38.935080 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: X-User-Domain-Name: Default Oct 17 03:05:38.935080 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: X-User-Id: f84d693b9d0643c69861a5541952b43b Oct 17 03:05:38.935080 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: X-User-Name: admin Oct 17 03:05:38.935080 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: method: > Oct 17 03:05:38.935080 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: exception: Flavor 451 could not be found. Oct 17 03:05:38.935080 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: action_args: {'id': '451'} Oct 17 03:05:38.935080 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: {{(pid=103856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 03:05:38.935080 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:05:38.936029 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 17 03:05:38.936029 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 17 03:05:38.936029 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 17 03:05:38.936029 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 17 03:05:38.936029 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 03:05:38.936029 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 03:05:38.936029 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 17 03:05:38.936029 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 17 03:05:38.936029 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 17 03:05:38.936029 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 03:05:38.936029 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 17 03:05:38.936029 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 17 03:05:38.936029 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 17 03:05:38.936029 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: ERROR nova.api.openstack.wsgi Oct 17 03:05:38.936029 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:05:38.936029 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: ERROR nova.api.openstack.wsgi Oct 17 03:05:38.936029 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:05:38.936029 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:05:38.936029 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:05:38.937137 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 03:05:38.937137 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 03:05:38.937137 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 03:05:38.937137 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 03:05:38.937137 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 17 03:05:38.937137 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 17 03:05:38.937137 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 17 03:05:38.937137 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: ERROR nova.api.openstack.wsgi Oct 17 03:05:38.937137 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:05:38.937137 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: ERROR nova.api.openstack.wsgi Oct 17 03:05:38.937137 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:05:38.937137 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:05:38.937137 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:05:38.937137 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 03:05:38.937137 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 03:05:38.937137 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 17 03:05:38.937137 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: ERROR nova.api.openstack.wsgi Oct 17 03:05:38.937137 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi [None req-d3862c51-f2bc-4cb0-9fab-db02a5106d8a admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103856) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 03:05:38.938185 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: INFO nova.api.openstack.requestlog [None req-d3862c51-f2bc-4cb0-9fab-db02a5106d8a admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.012370 Oct 17 03:05:38.938185 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: [pid: 103856|app: 0|req: 27/52] 10.222.0.27 () {60 vars in 1193 bytes} [Mon Oct 17 03:05:38 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Oct 17 03:05:40.162502 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi [None req-cd6465ea-abcd-4e3d-b513-e2b17c12201a admin admin] Calling method '>' {{(pid=103855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:05:40.163607 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: INFO nova.api.openstack.requestlog [None req-cd6465ea-abcd-4e3d-b513-e2b17c12201a admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001528 Oct 17 03:05:40.163995 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: [pid: 103855|app: 0|req: 26/53] 10.222.0.27 () {56 vars in 1074 bytes} [Mon Oct 17 03:05:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:05:40.686614 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi [None req-1e7012ff-a5e9-4060-b82a-79cc4e48dda0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:05:40.706346 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: INFO nova.api.openstack.requestlog [None req-1e7012ff-a5e9-4060-b82a-79cc4e48dda0 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.404625 Oct 17 03:05:40.706975 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: [pid: 103856|app: 0|req: 28/54] 10.222.0.27 () {64 vars in 1235 bytes} [Mon Oct 17 03:05:40 2022] POST /compute/v2.1/flavors => generated 404 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 03:05:41.915589 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi [None req-cd6465ea-abcd-4e3d-b513-e2b17c12201a admin admin] Calling method '>' {{(pid=103855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:05:41.916587 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: INFO nova.api.openstack.requestlog [None req-cd6465ea-abcd-4e3d-b513-e2b17c12201a admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Oct 17 03:05:41.917008 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: [pid: 103855|app: 0|req: 27/55] 10.222.0.27 () {56 vars in 1074 bytes} [Mon Oct 17 03:05:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:05:42.440433 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi [None req-b2ea7190-32ef-495a-aec4-661b72cec357 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:05:42.459234 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: INFO nova.api.openstack.requestlog [None req-b2ea7190-32ef-495a-aec4-661b72cec357 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.403368 Oct 17 03:05:42.459784 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: [pid: 103856|app: 0|req: 29/56] 10.222.0.27 () {64 vars in 1235 bytes} [Mon Oct 17 03:05:42 2022] POST /compute/v2.1/flavors => generated 405 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 03:05:43.672319 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi [None req-cd6465ea-abcd-4e3d-b513-e2b17c12201a admin admin] Calling method '>' {{(pid=103855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:05:43.673474 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: INFO nova.api.openstack.requestlog [None req-cd6465ea-abcd-4e3d-b513-e2b17c12201a admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001572 Oct 17 03:05:43.673865 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: [pid: 103855|app: 0|req: 28/57] 10.222.0.27 () {56 vars in 1074 bytes} [Mon Oct 17 03:05:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:05:44.199351 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi [None req-748c078d-a48a-4217-91aa-c6df489fd50b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:05:44.219147 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: INFO nova.api.openstack.requestlog [None req-748c078d-a48a-4217-91aa-c6df489fd50b admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.409246 Oct 17 03:05:44.220261 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: [pid: 103856|app: 0|req: 30/58] 10.222.0.27 () {64 vars in 1235 bytes} [Mon Oct 17 03:05:43 2022] POST /compute/v2.1/flavors => generated 407 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 03:05:45.456642 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi [None req-cd6465ea-abcd-4e3d-b513-e2b17c12201a admin admin] Calling method '>' {{(pid=103855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:05:45.457665 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: INFO nova.api.openstack.requestlog [None req-cd6465ea-abcd-4e3d-b513-e2b17c12201a admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 Oct 17 03:05:45.458060 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: [pid: 103855|app: 0|req: 29/59] 10.222.0.27 () {56 vars in 1074 bytes} [Mon Oct 17 03:05:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:05:45.976210 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi [None req-da031aad-78f7-4ec6-be3a-380ed2e91405 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:05:45.994891 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: INFO nova.api.openstack.requestlog [None req-da031aad-78f7-4ec6-be3a-380ed2e91405 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.396708 Oct 17 03:05:45.995483 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: [pid: 103856|app: 0|req: 31/60] 10.222.0.27 () {64 vars in 1235 bytes} [Mon Oct 17 03:05:45 2022] POST /compute/v2.1/flavors => generated 409 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 03:05:47.215312 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi [None req-cd6465ea-abcd-4e3d-b513-e2b17c12201a admin admin] Calling method '>' {{(pid=103855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:05:47.216368 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: INFO nova.api.openstack.requestlog [None req-cd6465ea-abcd-4e3d-b513-e2b17c12201a admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 Oct 17 03:05:47.216805 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: [pid: 103855|app: 0|req: 30/61] 10.222.0.27 () {56 vars in 1074 bytes} [Mon Oct 17 03:05:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:05:47.735735 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi [None req-2931cf85-e152-4a66-b7a7-b5f59e0b1f6b admin admin] Calling method '>' {{(pid=103856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:05:47.756110 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: INFO nova.api.openstack.requestlog [None req-2931cf85-e152-4a66-b7a7-b5f59e0b1f6b admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.400581 Oct 17 03:05:47.756634 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: [pid: 103856|app: 0|req: 32/62] 10.222.0.27 () {60 vars in 1202 bytes} [Mon Oct 17 03:05:47 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:06:44.127696 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi [None req-cd6465ea-abcd-4e3d-b513-e2b17c12201a admin admin] Calling method '>' {{(pid=103855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:06:44.128708 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: INFO nova.api.openstack.requestlog [None req-cd6465ea-abcd-4e3d-b513-e2b17c12201a admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001497 Oct 17 03:06:44.129110 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: [pid: 103855|app: 0|req: 31/63] 10.222.0.27 () {54 vars in 931 bytes} [Mon Oct 17 03:06:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:06:44.139277 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG dbcounter [-] [103856] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=103856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:06:44.518050 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi [None req-68233f61-b9f0-4996-ba9d-f554197e0300 admin admin] Calling method '>' {{(pid=103856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:06:44.538818 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: INFO nova.api.openstack.requestlog [None req-68233f61-b9f0-4996-ba9d-f554197e0300 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.403873 Oct 17 03:06:44.539316 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: [pid: 103856|app: 0|req: 33/64] 10.222.0.27 () {60 vars in 1292 bytes} [Mon Oct 17 03:06:44 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:06:44.560202 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG dbcounter [-] [103855] Writing DB stats nova_api:SELECT=14 {{(pid=103855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:06:44.564822 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi [None req-39ef9020-5a73-43b4-ade8-6632c3cd8222 admin admin] Calling method '>' {{(pid=103855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:06:44.572162 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: INFO nova.api.openstack.requestlog [None req-39ef9020-5a73-43b4-ade8-6632c3cd8222 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013388 Oct 17 03:06:44.572683 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: [pid: 103855|app: 0|req: 32/65] 10.222.0.27 () {60 vars in 1283 bytes} [Mon Oct 17 03:06:44 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:06:44.584756 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi [None req-23c43f96-6b54-4dc1-a3f6-29cf45769991 admin admin] Calling method '>' {{(pid=103856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:06:44.591940 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: INFO nova.api.openstack.requestlog [None req-23c43f96-6b54-4dc1-a3f6-29cf45769991 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010730 Oct 17 03:06:44.592451 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: [pid: 103856|app: 0|req: 34/66] 10.222.0.27 () {60 vars in 1286 bytes} [Mon Oct 17 03:06:44 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:06:44.603576 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi [None req-904d6009-9416-418d-84ec-454da59aa3d3 admin admin] Calling method '>' {{(pid=103855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:06:44.610636 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: INFO nova.api.openstack.requestlog [None req-904d6009-9416-418d-84ec-454da59aa3d3 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010615 Oct 17 03:06:44.611257 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: [pid: 103855|app: 0|req: 33/67] 10.222.0.27 () {60 vars in 1286 bytes} [Mon Oct 17 03:06:44 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:06:44.622337 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi [None req-7f1f8281-3e6a-4a49-b7fb-7ffe05901f58 admin admin] Calling method '>' {{(pid=103856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:06:44.629800 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: INFO nova.api.openstack.requestlog [None req-7f1f8281-3e6a-4a49-b7fb-7ffe05901f58 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010897 Oct 17 03:06:44.630304 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: [pid: 103856|app: 0|req: 35/68] 10.222.0.27 () {60 vars in 1283 bytes} [Mon Oct 17 03:06:44 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:09:41.388202 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi [None req-904d6009-9416-418d-84ec-454da59aa3d3 admin admin] Calling method '>' {{(pid=103855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:09:41.389214 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: INFO nova.api.openstack.requestlog [None req-904d6009-9416-418d-84ec-454da59aa3d3 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001494 Oct 17 03:09:41.389615 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: [pid: 103855|app: 0|req: 34/69] 10.222.0.27 () {56 vars in 1074 bytes} [Mon Oct 17 03:09:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:09:41.532319 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG dbcounter [-] [103856] Writing DB stats nova_api:SELECT=6 {{(pid=103856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:09:41.691930 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi [None req-e4e43148-3c4f-43ff-a446-463f1e442661 admin admin] Calling method '>' {{(pid=103856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:09:41.697306 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG oslo_concurrency.lockutils [None req-e4e43148-3c4f-43ff-a446-463f1e442661 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:09:41.697636 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG oslo_concurrency.lockutils [None req-e4e43148-3c4f-43ff-a446-463f1e442661 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:09:41.698069 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG oslo_concurrency.lockutils [None req-e4e43148-3c4f-43ff-a446-463f1e442661 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:09:41.698774 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG oslo_concurrency.lockutils [None req-e4e43148-3c4f-43ff-a446-463f1e442661 admin admin] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:09:41.699249 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG oslo_concurrency.lockutils [None req-e4e43148-3c4f-43ff-a446-463f1e442661 admin admin] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:09:41.699668 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG oslo_concurrency.lockutils [None req-e4e43148-3c4f-43ff-a446-463f1e442661 admin admin] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:09:41.732009 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: INFO nova.api.openstack.requestlog [None req-e4e43148-3c4f-43ff-a446-463f1e442661 admin admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.201021 Oct 17 03:09:41.733286 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: [pid: 103856|app: 0|req: 36/70] 10.222.0.27 () {60 vars in 1193 bytes} [Mon Oct 17 03:09:41 2022] GET /compute/v2.1/os-services => generated 791 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 17 03:09:42.816243 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi [None req-904d6009-9416-418d-84ec-454da59aa3d3 admin admin] Calling method '>' {{(pid=103855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:09:42.817318 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: INFO nova.api.openstack.requestlog [None req-904d6009-9416-418d-84ec-454da59aa3d3 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 Oct 17 03:09:42.817775 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: [pid: 103855|app: 0|req: 35/71] 10.222.0.27 () {56 vars in 1074 bytes} [Mon Oct 17 03:09:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:09:43.007077 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi [None req-16f14926-c5a3-4a28-9c97-e3b109710fbc admin admin] Calling method '>' {{(pid=103856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:09:43.010490 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG oslo_concurrency.lockutils [None req-16f14926-c5a3-4a28-9c97-e3b109710fbc admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:09:43.010998 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG oslo_concurrency.lockutils [None req-16f14926-c5a3-4a28-9c97-e3b109710fbc admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:09:43.011427 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG oslo_concurrency.lockutils [None req-16f14926-c5a3-4a28-9c97-e3b109710fbc admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:09:43.012131 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG oslo_concurrency.lockutils [None req-16f14926-c5a3-4a28-9c97-e3b109710fbc admin admin] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:09:43.012591 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG oslo_concurrency.lockutils [None req-16f14926-c5a3-4a28-9c97-e3b109710fbc admin admin] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:09:43.013003 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG oslo_concurrency.lockutils [None req-16f14926-c5a3-4a28-9c97-e3b109710fbc admin admin] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:09:43.033657 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: INFO nova.api.openstack.requestlog [None req-16f14926-c5a3-4a28-9c97-e3b109710fbc admin admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.077018 Oct 17 03:09:43.034444 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: [pid: 103856|app: 0|req: 37/72] 10.222.0.27 () {60 vars in 1193 bytes} [Mon Oct 17 03:09:42 2022] GET /compute/v2.1/os-services => generated 791 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 03:09:54.525452 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi [None req-904d6009-9416-418d-84ec-454da59aa3d3 admin admin] Calling method '>' {{(pid=103855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:09:54.526489 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: INFO nova.api.openstack.requestlog [None req-904d6009-9416-418d-84ec-454da59aa3d3 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Oct 17 03:09:54.526918 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: [pid: 103855|app: 0|req: 36/73] 10.222.0.27 () {56 vars in 1074 bytes} [Mon Oct 17 03:09:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:09:54.671692 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG dbcounter [-] [103856] Writing DB stats nova_cell0:SELECT=4 {{(pid=103856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:09:54.672434 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG dbcounter [-] [103856] Writing DB stats nova_cell1:SELECT=4 {{(pid=103856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:09:54.673069 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG dbcounter [-] [103856] Writing DB stats nova_api:SELECT=8 {{(pid=103856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:09:54.721456 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi [None req-049fb9c9-d44b-43b6-bd84-3931528b7a07 admin admin] Calling method '>' {{(pid=103856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:09:54.725526 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG oslo_concurrency.lockutils [None req-049fb9c9-d44b-43b6-bd84-3931528b7a07 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:09:54.725992 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG oslo_concurrency.lockutils [None req-049fb9c9-d44b-43b6-bd84-3931528b7a07 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:09:54.726415 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG oslo_concurrency.lockutils [None req-049fb9c9-d44b-43b6-bd84-3931528b7a07 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:09:54.727142 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG oslo_concurrency.lockutils [None req-049fb9c9-d44b-43b6-bd84-3931528b7a07 admin admin] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:09:54.727583 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG oslo_concurrency.lockutils [None req-049fb9c9-d44b-43b6-bd84-3931528b7a07 admin admin] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:09:54.727994 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG oslo_concurrency.lockutils [None req-049fb9c9-d44b-43b6-bd84-3931528b7a07 admin admin] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:09:54.752933 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: INFO nova.api.openstack.requestlog [None req-049fb9c9-d44b-43b6-bd84-3931528b7a07 admin admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.92 time: 0.085636 Oct 17 03:09:54.753406 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: [pid: 103856|app: 0|req: 38/74] 10.222.0.27 () {60 vars in 1193 bytes} [Mon Oct 17 03:09:54 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:09:55.819362 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG nova.api.openstack.wsgi [None req-904d6009-9416-418d-84ec-454da59aa3d3 admin admin] Calling method '>' {{(pid=103855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:09:55.820357 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: INFO nova.api.openstack.requestlog [None req-904d6009-9416-418d-84ec-454da59aa3d3 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 Oct 17 03:09:55.820744 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: [pid: 103855|app: 0|req: 37/75] 10.222.0.27 () {56 vars in 1074 bytes} [Mon Oct 17 03:09:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:09:56.009898 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG nova.api.openstack.wsgi [None req-5ec2a6cd-4530-4374-abc9-b6ea120f7807 admin admin] Calling method '>' {{(pid=103856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:09:56.013245 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG oslo_concurrency.lockutils [None req-5ec2a6cd-4530-4374-abc9-b6ea120f7807 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:09:56.013711 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG oslo_concurrency.lockutils [None req-5ec2a6cd-4530-4374-abc9-b6ea120f7807 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:09:56.014132 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG oslo_concurrency.lockutils [None req-5ec2a6cd-4530-4374-abc9-b6ea120f7807 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:09:56.014829 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG oslo_concurrency.lockutils [None req-5ec2a6cd-4530-4374-abc9-b6ea120f7807 admin admin] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:09:56.015298 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG oslo_concurrency.lockutils [None req-5ec2a6cd-4530-4374-abc9-b6ea120f7807 admin admin] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:09:56.015708 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: DEBUG oslo_concurrency.lockutils [None req-5ec2a6cd-4530-4374-abc9-b6ea120f7807 admin admin] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:09:56.038070 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: INFO nova.api.openstack.requestlog [None req-5ec2a6cd-4530-4374-abc9-b6ea120f7807 admin admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.92 time: 0.079096 Oct 17 03:09:56.038547 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: [pid: 103856|app: 0|req: 39/76] 10.222.0.27 () {60 vars in 1193 bytes} [Mon Oct 17 03:09:55 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:10:54.442056 dv-cinder-846977-2-iscsi devstack@n-api.service[103854]: Mon Oct 17 03:10:54 2022 - graceful shutdown triggered... Oct 17 03:10:54.442181 dv-cinder-846977-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Oct 17 03:10:54.443232 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: Gracefully killing worker 1 (pid: 103855)... Oct 17 03:10:54.443627 dv-cinder-846977-2-iscsi devstack@n-api.service[103856]: Gracefully killing worker 2 (pid: 103856)... Oct 17 03:10:54.577870 dv-cinder-846977-2-iscsi devstack@n-api.service[103855]: DEBUG dbcounter [-] [103855] Writing DB stats nova_api:SELECT=4 {{(pid=103855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:10:55.444166 dv-cinder-846977-2-iscsi devstack@n-api.service[103854]: worker 1 buried after 1 seconds Oct 17 03:10:55.444613 dv-cinder-846977-2-iscsi devstack@n-api.service[103854]: worker 2 buried after 1 seconds Oct 17 03:10:55.444613 dv-cinder-846977-2-iscsi devstack@n-api.service[103854]: goodbye to uWSGI. Oct 17 03:10:55.445758 dv-cinder-846977-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. Oct 17 03:10:55.446323 dv-cinder-846977-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Oct 17 03:10:55.449157 dv-cinder-846977-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Oct 17 03:10:55.462055 dv-cinder-846977-2-iscsi devstack@n-api.service[118867]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 17 03:10:55.464551 dv-cinder-846977-2-iscsi devstack@n-api.service[118867]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Oct 17 03:10:55 2022] *** Oct 17 03:10:55.464551 dv-cinder-846977-2-iscsi devstack@n-api.service[118867]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 17 03:10:55.464551 dv-cinder-846977-2-iscsi devstack@n-api.service[118867]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 17 03:10:55.464551 dv-cinder-846977-2-iscsi devstack@n-api.service[118867]: nodename: dv-cinder-846977-2-iscsi Oct 17 03:10:55.464551 dv-cinder-846977-2-iscsi devstack@n-api.service[118867]: machine: x86_64 Oct 17 03:10:55.464551 dv-cinder-846977-2-iscsi devstack@n-api.service[118867]: clock source: unix Oct 17 03:10:55.464551 dv-cinder-846977-2-iscsi devstack@n-api.service[118867]: pcre jit disabled Oct 17 03:10:55.464551 dv-cinder-846977-2-iscsi devstack@n-api.service[118867]: detected number of CPU cores: 4 Oct 17 03:10:55.464551 dv-cinder-846977-2-iscsi devstack@n-api.service[118867]: current working directory: / Oct 17 03:10:55.464551 dv-cinder-846977-2-iscsi devstack@n-api.service[118867]: detected binary path: /usr/bin/uwsgi-core Oct 17 03:10:55.464551 dv-cinder-846977-2-iscsi devstack@n-api.service[118867]: your processes number limit is 47680 Oct 17 03:10:55.464551 dv-cinder-846977-2-iscsi devstack@n-api.service[118867]: your memory page size is 4096 bytes Oct 17 03:10:55.464551 dv-cinder-846977-2-iscsi devstack@n-api.service[118867]: detected max file descriptor number: 2048 Oct 17 03:10:55.464551 dv-cinder-846977-2-iscsi devstack@n-api.service[118867]: lock engine: pthread robust mutexes Oct 17 03:10:55.464551 dv-cinder-846977-2-iscsi devstack@n-api.service[118867]: thunder lock: enabled Oct 17 03:10:55.465516 dv-cinder-846977-2-iscsi devstack@n-api.service[118867]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 17 03:10:55.465516 dv-cinder-846977-2-iscsi devstack@n-api.service[118867]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 17 03:10:55.506406 dv-cinder-846977-2-iscsi devstack@n-api.service[118867]: Python main interpreter initialized at 0x5557344ec9c0 Oct 17 03:10:55.506406 dv-cinder-846977-2-iscsi devstack@n-api.service[118867]: python threads support enabled Oct 17 03:10:55.506406 dv-cinder-846977-2-iscsi devstack@n-api.service[118867]: your server socket listen backlog is limited to 100 connections Oct 17 03:10:55.506406 dv-cinder-846977-2-iscsi devstack@n-api.service[118867]: your mercy for graceful operations on workers is 90 seconds Oct 17 03:10:55.506824 dv-cinder-846977-2-iscsi devstack@n-api.service[118867]: mapped 403077 bytes (393 KB) for 2 cores Oct 17 03:10:55.506937 dv-cinder-846977-2-iscsi devstack@n-api.service[118867]: *** Operational MODE: preforking *** Oct 17 03:10:55.507163 dv-cinder-846977-2-iscsi devstack@n-api.service[118867]: *** uWSGI is running in multiple interpreter mode *** Oct 17 03:10:55.507163 dv-cinder-846977-2-iscsi devstack@n-api.service[118867]: spawned uWSGI master process (pid: 118867) Oct 17 03:10:55.507386 dv-cinder-846977-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Oct 17 03:10:55.508087 dv-cinder-846977-2-iscsi devstack@n-api.service[118867]: spawned uWSGI worker 1 (pid: 118886, cores: 1) Oct 17 03:10:55.509114 dv-cinder-846977-2-iscsi devstack@n-api.service[118867]: spawned uWSGI worker 2 (pid: 118887, cores: 1) Oct 17 03:10:55.509114 dv-cinder-846977-2-iscsi devstack@n-api.service[118867]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 17 03:10:56.165317 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 17 03:10:56.165929 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 17 03:10:57.318990 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 17 03:10:57.318990 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: from cryptography.utils import int_from_bytes Oct 17 03:10:57.319689 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 17 03:10:57.319689 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: from cryptography.utils import int_from_bytes Oct 17 03:10:57.320101 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 17 03:10:57.320101 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: from cryptography.utils import int_from_bytes Oct 17 03:10:57.321021 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 17 03:10:57.321021 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: from cryptography.utils import int_from_bytes Oct 17 03:10:59.723612 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 17 03:10:59.724312 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 17 03:10:59.724407 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 17 03:10:59.724407 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 17 03:10:59.724856 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 17 03:10:59.724933 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 17 03:10:59.725012 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 17 03:10:59.725012 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 17 03:10:59.725519 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 17 03:10:59.725519 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 17 03:10:59.725705 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.725705 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.725858 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.725938 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.726010 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.727247 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.727397 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.727527 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.727676 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.727837 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.727977 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.728066 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.728139 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.728216 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.728294 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.728536 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.728650 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.728733 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.728816 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.729003 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.729158 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.729365 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.729527 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-846977-2-iscsi {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.729766 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.729938 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-846977-2-iscsi {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.730089 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.730239 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.730396 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.730551 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.730698 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.730848 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.731042 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.731241 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.731405 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.731557 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.731678 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.731775 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.732018 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.732474 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.732656 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.732809 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.733019 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.733280 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.733512 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.733704 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.733704 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.733872 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.733951 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.734034 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.734034 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.734245 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.734406 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.734504 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.734627 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.734777 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.734953 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.735113 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.735272 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.735441 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.735588 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.735691 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-846977-2-iscsi {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.735957 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-846977-2-iscsi {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.736057 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.736266 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.736465 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.736557 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.736639 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.736867 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.737050 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.737391 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.737494 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.737600 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.737687 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.737863 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.737957 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.738184 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.738288 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.738489 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.738581 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.738814 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.738925 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.739157 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.739305 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.739474 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.739566 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.739797 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.739936 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.740084 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.740189 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.740388 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.740481 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.740691 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.740794 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.740996 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.741088 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.741296 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.741395 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.741602 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.741736 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.741848 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.741947 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.742752 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.742888 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.743179 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.743294 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.743518 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.743626 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.743826 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.743941 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.744076 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.744180 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.744325 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.744420 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.744621 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.744714 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.744944 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.745060 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.745250 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.745366 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.745553 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.745656 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.745857 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.745960 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.746159 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.746260 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.746461 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.746552 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.746764 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.746857 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.747090 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.747194 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.747393 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.747499 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.747709 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.747810 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.748019 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.748119 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.748339 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.748446 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.748644 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.748743 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.748959 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.749058 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.749300 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.749404 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.27 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.749587 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.27 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.749718 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.27 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.749891 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.749983 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.27 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.750227 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.750331 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.750544 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.750636 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.750849 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.750996 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.751184 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.751287 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.751504 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.751605 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.751814 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.751918 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.752117 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.752229 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.752422 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.752525 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.752729 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.752855 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.753045 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.753149 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.753356 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.753458 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.753605 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.753706 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.753905 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.754015 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.754202 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.754293 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.754506 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.754606 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.754808 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.754937 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.755140 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.755253 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.755479 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.755652 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.755758 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.755845 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.756029 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.756171 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.756333 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.756642 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.756946 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.758984 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.759080 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.759165 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.759246 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.759335 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.759416 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.759496 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.759577 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.759651 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.759729 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.759811 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.759885 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.759957 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.760035 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.760140 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.761434 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.761537 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.761637 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.761743 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.761743 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.761906 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.761990 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.762084 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.762169 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.762252 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.762352 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.762438 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.762522 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.762618 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.762712 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.762798 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.762895 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.762972 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.763054 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.763152 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.763248 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.763341 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.763426 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.763518 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.763619 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.763717 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.763810 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.763892 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.763972 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.764057 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.764155 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.764249 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.764334 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.764516 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.764624 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.764829 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.764938 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.765187 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.765303 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.765434 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.765550 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.765741 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.765886 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.766042 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.766139 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.766343 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.766438 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.766644 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.766738 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.766965 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.767266 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.767563 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.767883 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.768056 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.768202 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.768294 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.768507 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.768669 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.768798 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.768931 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.769117 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.769260 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.769414 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.769512 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.769737 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.769842 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.770049 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.770150 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.770361 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.770467 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.770665 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.770767 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.771019 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 03:10:59.771129 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.771348 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.771447 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.771665 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.771758 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.771981 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.772103 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.772293 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.772442 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.772601 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.772746 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.772915 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.773080 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.773265 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.773415 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.773726 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.773862 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.774049 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.774442 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.774612 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.774756 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.774958 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.775115 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.775287 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.775496 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.775653 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.775817 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.775978 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.776079 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.776175 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.776271 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.776490 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.776585 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.776814 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.776914 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.777131 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.777224 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.777441 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.777607 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.777751 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.777846 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.778074 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.778174 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.778403 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.778509 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.778723 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.778814 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.779064 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.779167 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.779374 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.779475 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.779685 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.779789 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.779993 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.780094 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.780337 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.780478 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.780649 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.780742 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.780961 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.781062 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.781274 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.781432 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.781582 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.781680 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.781902 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.781995 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.782212 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.782313 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.782518 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.782618 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.782826 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.783038 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.783186 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.783285 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.783455 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.783556 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.783788 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.783881 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.784096 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.784233 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.784407 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.784509 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.784718 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.784810 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.785025 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.785118 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.785342 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.785442 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.785656 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.785763 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.785964 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.786105 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.786274 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.786368 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.786578 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.786682 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.786896 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.787010 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.787213 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.787321 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.787512 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.787615 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.787816 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.787918 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.788120 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.788218 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.788426 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.788529 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.788732 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.788833 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.789571 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.789674 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.789882 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.790003 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.790191 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.790298 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.790533 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.790651 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.790809 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.790934 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.791140 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.791275 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.791453 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.791572 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.791764 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.791906 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.792068 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.792195 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.792377 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.792505 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.792683 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.792805 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.792994 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.793172 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.793299 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.793423 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.793685 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.793844 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.793969 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.794082 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.794205 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.794327 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.794492 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.794614 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.794831 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.795003 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.795132 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.795261 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.795508 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.795640 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.795854 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.795974 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.796086 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.796211 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.796335 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.796454 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.796664 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.796783 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.796974 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.797104 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.797281 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.797400 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.797594 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.797712 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.797905 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.798049 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.798218 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.798350 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.798521 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.798650 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.798830 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.799030 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.799152 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.799249 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.799446 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.799541 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.799798 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.799937 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.800062 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.800178 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.800364 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.800510 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.800666 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.800813 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.800968 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.801064 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.801268 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.801368 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.801569 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.801670 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.801869 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.801968 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.802173 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.802280 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.802473 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.802564 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.802772 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.802898 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.803100 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.803207 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.803422 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.803561 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.803729 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.803831 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.804031 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.804136 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.804335 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.804439 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.804692 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.804789 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.805082 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.805319 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.805435 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.805582 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.805742 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.805851 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.805986 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.806110 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.806298 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.806413 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.806608 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.806712 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.806939 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.807057 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.807255 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.807355 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.807564 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.807660 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.807873 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.807976 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.808182 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.808293 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.808494 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.808667 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.808832 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.808975 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.809124 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.809268 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.809421 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.809523 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.809692 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.809793 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.810027 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.810120 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.810335 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.810567 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.810725 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.811017 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.811183 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.811340 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.811493 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.811647 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.811647 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.811868 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.811959 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.812032 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.812173 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.812285 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.812482 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.812575 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.812906 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.813039 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.813153 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.813242 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.813459 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.813578 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.813709 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.813803 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.814014 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.814117 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.814319 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.814419 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.814626 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.814725 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.814956 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.815067 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.815258 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.815372 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.815566 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.815661 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.815884 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.815980 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.816194 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.816300 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.816504 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.816595 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.816802 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.816904 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.817116 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.817208 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.817420 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.817522 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.817729 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.817822 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.818040 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.818144 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.818342 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.818445 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.818648 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.818755 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.818976 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.819072 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.819286 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.819394 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.819592 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.819690 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.819895 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.819993 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.820715 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.820891 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.821056 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.821155 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.821318 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.821418 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.821619 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.821720 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.821920 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.822014 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.822222 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.822313 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.822535 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.822636 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.822839 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.822952 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.823164 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.823268 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.823467 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.823626 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.823777 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.823874 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.824079 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.824172 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.824393 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.824494 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.824697 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.824796 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.825000 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.825106 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.825304 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.825403 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.825604 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.825695 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.825925 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.826030 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.826238 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.826366 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.826538 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.826653 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.826839 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.826980 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.827162 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.827263 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.827480 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.827580 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.827796 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.827951 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.828097 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.828195 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.828404 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.828501 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.828791 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.828937 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.829039 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.829115 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.829335 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.829447 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.829634 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.829753 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.829942 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.830055 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.830252 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.830353 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.830562 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.830655 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.830898 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.830993 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.831206 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.831318 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.831513 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.831621 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.831822 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.831957 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.832126 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.832228 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.832437 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.832541 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.832748 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.832846 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.833062 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.833338 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.833432 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.833676 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.833776 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.833967 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.834070 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.834286 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.834380 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.834635 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.834880 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.835023 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.835239 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.835333 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.835561 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.835654 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.836419 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.836561 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.836858 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.837031 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.837230 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.837343 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.837538 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.837639 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.837845 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.837965 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.838158 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.838251 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.838464 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.838555 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.838860 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.839100 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.839374 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.839542 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.839692 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.839847 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.840002 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.840159 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.840266 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.840364 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.840458 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.840545 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.840638 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.840735 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.840916 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.841037 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.841227 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.841349 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.841529 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.841626 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.841833 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.841935 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.842137 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.842232 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.842457 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.842576 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.842764 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.842943 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.843189 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.843345 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.843505 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.843657 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.843889 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.844049 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.844195 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.844339 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.844444 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.844533 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.844698 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.844797 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.845004 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.845111 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.845352 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.845454 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.845661 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.845753 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.846000 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.846100 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.846307 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.846400 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.846614 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.846712 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.846947 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.847070 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.847260 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.847353 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.847569 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.847668 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.847874 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.847967 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.848185 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.848287 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.848487 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.848579 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.848798 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.848913 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.849150 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.849252 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.849395 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.849489 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.849702 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.849796 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.850005 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.850122 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.850314 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.850415 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.850620 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.850714 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.850944 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.851054 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.851250 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.851458 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.851590 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.851734 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.851883 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.852041 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.852188 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.852358 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.852462 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.852664 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.852765 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.852970 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.853062 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.853280 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.853374 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.853588 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.853689 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.853898 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.854075 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.854241 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.854391 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.854546 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.854699 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.854845 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.855105 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.855260 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.855405 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.855548 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.855700 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.855850 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.856002 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.856145 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.856286 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.856429 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.856571 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.856714 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.856867 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.856867 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.857209 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.857513 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.857664 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.857664 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.857958 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.858104 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.858266 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.858366 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.858453 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.858595 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.858693 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.858779 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.858880 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.858980 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.859147 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.859270 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.859367 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.859543 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.859705 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.859851 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.860004 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.860158 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.860307 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.860457 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.860606 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.860758 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.860908 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.861056 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.861207 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.861348 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.861505 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.861653 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.861806 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.861945 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.862088 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.862238 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.862386 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.862544 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.862685 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.862833 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.862977 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.863114 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.863205 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.863419 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.863564 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.863720 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.863812 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.864029 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.864145 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.865376 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.865525 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.865525 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.865712 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.865712 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.865879 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.865879 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.865879 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.865879 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.866214 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.866394 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.866720 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.873382 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.873590 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.873760 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.873760 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.874047 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.874301 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.874464 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.874619 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.874765 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.874957 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.875116 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.875270 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.875421 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.875573 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.875573 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.875873 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.876016 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.876181 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.876326 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.876468 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.876617 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.876760 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.876903 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.877058 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.877221 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.877444 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.877610 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.877829 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.878008 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.878154 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.878352 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.878513 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.878659 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.878812 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.879001 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.879001 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.879508 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.879669 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.879835 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.880067 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.880239 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.880384 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.880554 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.880793 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.880951 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.881098 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.881252 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.881405 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.881555 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.881789 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.881946 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.882101 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.882245 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.882401 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.882545 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.883254 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.883494 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.883892 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.884061 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.884210 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.884443 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.884606 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.884751 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.884909 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.885053 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.885209 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.885366 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.885510 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.885510 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.885807 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.885960 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.886104 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.886104 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.886376 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.886528 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.886691 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.886835 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.887028 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.887185 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.887329 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.887329 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.887725 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.887957 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.888109 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.888264 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.888455 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.888616 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.888760 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.888911 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.889055 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.889206 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.889367 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.889737 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.889986 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.890242 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.890404 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.890559 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.890713 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.890857 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.891132 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.891285 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.891439 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.891439 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.891815 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.892045 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.892203 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.892356 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.892501 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.892652 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.892814 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.892966 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.893110 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.893110 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.893382 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.893525 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.893808 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.893983 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.894142 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.894286 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.894455 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.894688 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.894850 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.895022 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.895177 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.895322 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.895465 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.895617 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.895861 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.896024 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.896189 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.896342 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.896487 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.896642 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.896788 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.896974 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.897132 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.897291 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.897436 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.897596 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.897816 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.897998 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.898255 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.898584 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.898826 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.899333 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.899503 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.899901 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.900065 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.900245 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.900487 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.900680 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.900839 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.900993 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.901166 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.901398 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.901576 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.901731 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.901731 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.902035 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.902035 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.902402 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.902547 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.902704 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.902882 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.903036 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.903036 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.903332 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.903495 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.903647 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.903803 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.903955 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.904108 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.904263 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.904408 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.904551 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.904714 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.904938 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.905089 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.905233 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.905377 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.905531 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.905683 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.905838 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.905989 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.906140 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.906285 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.906428 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.906585 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.907257 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.907431 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.907583 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.907736 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.907973 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.908147 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.908396 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.908602 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.908754 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.908900 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.909044 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.909205 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.909350 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.909494 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.909693 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.910057 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.910218 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.910375 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.910641 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.910802 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.910984 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.911138 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.911290 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.911546 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.911698 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.911853 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.912006 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.912151 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.912381 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.912553 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.912709 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.912872 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.913017 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.913174 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.913332 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.913483 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.913628 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.913771 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.914449 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.914666 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.915100 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.915291 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.915291 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.915595 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.915741 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.915894 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.916072 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.916346 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.916508 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.916692 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.916848 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.917001 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.917167 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.917321 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.917473 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.917623 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.917781 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.917953 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.918184 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.918184 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.918563 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.918763 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.918941 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.919103 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.919257 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.919410 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.919555 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.919706 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.919853 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.920206 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.920361 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.920506 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.920676 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.920918 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.921078 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.921232 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.921385 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.921556 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.921796 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.921956 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.922110 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.922282 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.922520 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.922673 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.922826 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.923020 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.923185 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.923330 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.923474 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.923618 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.923761 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.923911 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.924070 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.924215 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.924377 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.924529 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.924672 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.924824 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.925046 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.925284 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.925434 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.925579 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.925722 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.925876 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.925876 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.926189 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.926361 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.926587 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.926587 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.926917 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.927093 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.927244 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.927388 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.927532 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.927743 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.927907 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.928052 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.928052 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.928428 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.928428 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.928862 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.929092 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.929251 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.929406 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.930387 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.930634 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.930938 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.931209 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.931376 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.931539 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.931685 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.931975 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.932149 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.932303 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.932456 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.932729 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.932890 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.933037 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.933200 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.933345 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.933490 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.933645 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.933791 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.933948 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.934115 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.934262 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.934413 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.934558 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.934708 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.934879 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.935034 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.935179 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.935411 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.935576 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.935730 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.935885 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.936051 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.936196 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.936347 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.936494 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.936733 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.936886 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.937038 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.937189 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.937336 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.937489 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.937634 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.937785 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.937947 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.938094 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.938246 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.938417 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.938417 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.938776 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.939103 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.939249 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.939405 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.939560 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.939705 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.939856 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.940019 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.940171 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.940477 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.940640 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.940787 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.940940 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.941085 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.941347 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.941514 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.941676 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.941830 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.941830 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.942249 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.942249 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.942548 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.942717 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.942962 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.943133 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.943285 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.943285 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.943581 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.943734 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.943892 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.944053 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.944205 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.944374 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.944526 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.944676 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.944834 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.944994 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.945188 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.945408 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.945759 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.946008 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.946182 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.946343 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.946495 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.946659 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.946954 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.947118 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.947291 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.947444 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.947603 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.947765 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.947924 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.948076 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.948236 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.948396 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.948560 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.948819 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.949055 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.949055 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.949435 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.949596 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.949761 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.949761 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.950066 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.950359 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.950701 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.950885 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.951062 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.951224 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.951497 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.951675 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.951675 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.951964 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.952141 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.952395 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.952553 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.952712 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.952876 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.953137 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.953305 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.953459 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.953617 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.953768 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.953931 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.954091 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.954258 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.954410 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.954561 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.954719 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.954895 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.955067 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.955227 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.955378 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.956205 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.956370 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.956531 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.956714 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.956894 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.957137 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.957311 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.957464 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.957630 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.957789 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.957948 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.958099 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.958250 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.958408 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.958630 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.958815 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.959108 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.959286 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.959525 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.959683 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.959846 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.960006 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.960165 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.960325 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.960325 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.960641 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.961065 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.961316 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.961556 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.961721 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.961721 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.962022 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.962200 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.962546 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.962715 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.962903 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.963063 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.963322 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.963481 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.963652 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.963942 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.964115 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.964267 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.964430 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.964591 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.964741 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.964893 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.965051 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.965203 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.965523 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.965697 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.965937 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.966106 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.966272 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.966272 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.966601 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.966759 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.966940 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.967117 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.967348 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.967520 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.967674 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.967674 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.967981 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.968133 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.968310 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.968580 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.968752 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.968906 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.969076 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.969348 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.969535 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.969775 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.969935 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.970086 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.970249 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.970408 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.970568 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.970727 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.971113 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.971286 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.971439 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.971597 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.971763 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.971924 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.972076 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.972226 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.972226 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.972711 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.972882 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.973035 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.973208 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.973495 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.973656 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.973817 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.973979 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.974131 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.974282 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.974441 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.974600 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.974759 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.974996 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.975155 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.975324 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.975487 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.975653 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.975817 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.976062 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.976222 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.976889 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.977054 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.977336 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.977702 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.977877 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.978031 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.978181 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.978343 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.978509 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.978662 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.978825 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.979015 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.979303 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.979476 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.979642 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.979889 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.980048 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.980201 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.980360 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.980526 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.980696 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.980855 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.981033 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.981356 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.981513 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.981677 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.981839 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.981990 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.982140 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.982140 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.982427 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.982586 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.983041 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.983213 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.983366 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.983620 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.983796 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.983948 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.984098 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.984248 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.984398 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.984555 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.984719 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.984873 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.985042 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.985205 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.985356 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.985506 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.985665 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.985816 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.985967 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.986211 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.986378 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.986530 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.986690 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.986842 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.987020 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.987199 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.987359 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.987519 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.987768 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.987935 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.988101 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.988261 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.988420 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.988585 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.988737 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.988888 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.989039 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.989189 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.989491 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.989661 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.989821 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.990079 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.990329 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.990488 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.990649 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.990809 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.991020 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.991202 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.991502 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.991663 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.991842 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.992055 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.992055 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.993173 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.993512 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.993885 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.994142 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.994312 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.994474 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.994627 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.994785 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.994994 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.995163 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.995329 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.995481 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.995632 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.995794 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.996004 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.996163 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.996420 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.996585 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.996776 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.996933 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.997092 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.997253 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.997405 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.997567 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.997745 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.997980 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.998152 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.998312 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.998471 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.998623 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.998773 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.998942 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.999116 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.999277 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.999550 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.999711 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:10:59.999881 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:11:00.000065 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:11:00.000302 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:11:00.000469 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:11:00.000623 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:11:00.000781 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:11:00.000781 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:11:00.001085 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:11:00.001237 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:11:00.001395 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:11:00.001723 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:11:00.001888 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:11:00.002050 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:11:00.002218 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:11:00.002370 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:11:00.002370 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:11:00.002370 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:11:00.002370 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:11:00.002370 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:11:00.002370 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:11:00.002370 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:11:00.002370 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:11:00.003827 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:11:00.003939 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:11:00.004039 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:11:00.004250 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:11:00.004388 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:11:00.004521 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:11:00.004652 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:11:00.004785 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:11:00.004931 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:11:00.005063 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:11:00.005202 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:11:00.005334 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:11:00.005473 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:11:00.005604 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:11:00.005749 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:11:00.005749 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:11:00.006015 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:11:00.006154 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:11:00.006292 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:11:00.006458 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:11:00.006661 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:11:00.006795 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:11:00.007006 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:11:00.007138 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:11:00.007266 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:11:00.007409 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:11:00.007541 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:11:00.007711 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:11:00.007871 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:11:00.008198 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:11:00.008414 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:11:00.008595 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:11:00.008738 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:11:00.008870 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:11:00.009011 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:11:00.009145 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:11:00.009290 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:11:00.009423 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:11:00.009678 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:11:00.009816 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:11:00.009948 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:11:00.010079 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 17 03:11:00.010230 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:11:00.010230 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:11:00.010230 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:11:00.010230 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:11:00.010230 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:11:00.010230 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:11:00.010230 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:11:00.010230 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:11:00.011401 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:11:00.011401 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:11:00.011401 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:11:00.011401 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:11:00.011401 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:11:00.011401 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:11:00.011401 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:11:00.011401 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:11:00.012597 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 03:11:00.012597 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 17 03:11:00.051977 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO dbcounter [None req-1b570af8-ee41-4e95-8b7f-b5d283618789 None None] Registered counter for database nova_api Oct 17 03:11:00.062039 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO dbcounter [None req-f57ab840-247d-4648-bce4-24adb619f9e6 None None] Registered counter for database nova_api Oct 17 03:11:00.074583 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_db.sqlalchemy.engines [None req-1b570af8-ee41-4e95-8b7f-b5d283618789 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118887) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 17 03:11:00.081529 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG dbcounter [-] [118887] Writer thread running {{(pid=118887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 17 03:11:00.082780 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_db.sqlalchemy.engines [None req-f57ab840-247d-4648-bce4-24adb619f9e6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118886) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 17 03:11:00.090249 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG dbcounter [-] [118886] Writer thread running {{(pid=118886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 17 03:11:00.139001 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.context [None req-1b570af8-ee41-4e95-8b7f-b5d283618789 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),bae72ffa-7a7a-461b-9de6-69e8d04af1a1(cell1) {{(pid=118887) load_cells /opt/stack/nova/nova/context.py:464}} Oct 17 03:11:00.142943 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-1b570af8-ee41-4e95-8b7f-b5d283618789 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:11:00.143412 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-1b570af8-ee41-4e95-8b7f-b5d283618789 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:11:00.144987 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-1b570af8-ee41-4e95-8b7f-b5d283618789 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:11:00.145699 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-1b570af8-ee41-4e95-8b7f-b5d283618789 None None] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:11:00.146138 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-1b570af8-ee41-4e95-8b7f-b5d283618789 None None] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:11:00.146564 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.context [None req-f57ab840-247d-4648-bce4-24adb619f9e6 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),bae72ffa-7a7a-461b-9de6-69e8d04af1a1(cell1) {{(pid=118886) load_cells /opt/stack/nova/nova/context.py:464}} Oct 17 03:11:00.148189 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-1b570af8-ee41-4e95-8b7f-b5d283618789 None None] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:11:00.150833 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO dbcounter [None req-1b570af8-ee41-4e95-8b7f-b5d283618789 None None] Registered counter for database nova_cell0 Oct 17 03:11:00.150976 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-f57ab840-247d-4648-bce4-24adb619f9e6 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:11:00.151331 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-f57ab840-247d-4648-bce4-24adb619f9e6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:11:00.152947 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-f57ab840-247d-4648-bce4-24adb619f9e6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:11:00.153703 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-f57ab840-247d-4648-bce4-24adb619f9e6 None None] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:11:00.154130 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-f57ab840-247d-4648-bce4-24adb619f9e6 None None] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:11:00.154842 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO dbcounter [None req-1b570af8-ee41-4e95-8b7f-b5d283618789 None None] Registered counter for database nova_cell1 Oct 17 03:11:00.156148 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-f57ab840-247d-4648-bce4-24adb619f9e6 None None] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:11:00.158221 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO dbcounter [None req-f57ab840-247d-4648-bce4-24adb619f9e6 None None] Registered counter for database nova_cell0 Oct 17 03:11:00.161859 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_db.sqlalchemy.engines [None req-1b570af8-ee41-4e95-8b7f-b5d283618789 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118887) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 17 03:11:00.162420 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO dbcounter [None req-f57ab840-247d-4648-bce4-24adb619f9e6 None None] Registered counter for database nova_cell1 Oct 17 03:11:00.163317 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_db.sqlalchemy.engines [None req-1b570af8-ee41-4e95-8b7f-b5d283618789 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118887) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 17 03:11:00.169660 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_db.sqlalchemy.engines [None req-f57ab840-247d-4648-bce4-24adb619f9e6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118886) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 17 03:11:00.171468 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG dbcounter [-] [118887] Writer thread running {{(pid=118887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 17 03:11:00.172180 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG dbcounter [-] [118887] Writer thread running {{(pid=118887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 17 03:11:00.172265 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_db.sqlalchemy.engines [None req-f57ab840-247d-4648-bce4-24adb619f9e6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118886) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 17 03:11:00.176107 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG dbcounter [-] [118886] Writer thread running {{(pid=118886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 17 03:11:00.316029 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG dbcounter [-] [118886] Writer thread running {{(pid=118886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 17 03:11:00.321602 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO dbcounter [None req-1b570af8-ee41-4e95-8b7f-b5d283618789 None None] Registered counter for database nova_cell0 Oct 17 03:11:00.326884 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO dbcounter [None req-f57ab840-247d-4648-bce4-24adb619f9e6 None None] Registered counter for database nova_cell0 Oct 17 03:11:00.328314 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_db.sqlalchemy.engines [None req-1b570af8-ee41-4e95-8b7f-b5d283618789 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118887) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 17 03:11:00.332805 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG dbcounter [-] [118887] Writer thread running {{(pid=118887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 17 03:11:00.333303 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_db.sqlalchemy.engines [None req-f57ab840-247d-4648-bce4-24adb619f9e6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118886) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 17 03:11:00.337687 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG dbcounter [-] [118886] Writer thread running {{(pid=118886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 17 03:11:00.655416 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: WARNING keystonemiddleware.auth_token [None req-f57ab840-247d-4648-bce4-24adb619f9e6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 17 03:11:00.657876 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: WARNING keystonemiddleware.auth_token [None req-1b570af8-ee41-4e95-8b7f-b5d283618789 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 17 03:11:00.662619 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: WARNING keystonemiddleware.auth_token [None req-f57ab840-247d-4648-bce4-24adb619f9e6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 17 03:11:00.665120 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: WARNING keystonemiddleware.auth_token [None req-1b570af8-ee41-4e95-8b7f-b5d283618789 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 17 03:11:01.005800 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: WARNING keystonemiddleware.auth_token [None req-f57ab840-247d-4648-bce4-24adb619f9e6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 17 03:11:01.012015 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: WARNING keystonemiddleware.auth_token [None req-f57ab840-247d-4648-bce4-24adb619f9e6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 17 03:11:01.015939 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: WARNING keystonemiddleware.auth_token [None req-1b570af8-ee41-4e95-8b7f-b5d283618789 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 17 03:11:01.017241 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5557344ec9c0 pid: 118886 (default app) Oct 17 03:11:01.022405 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: WARNING keystonemiddleware.auth_token [None req-1b570af8-ee41-4e95-8b7f-b5d283618789 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 17 03:11:01.028877 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5557344ec9c0 pid: 118887 (default app) Oct 17 03:11:37.313288 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG dbcounter [-] [118886] Writing DB stats nova_api:SELECT=3 {{(pid=118886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:11:37.315126 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG dbcounter [-] [118886] Writing DB stats nova_cell1:SELECT=3 {{(pid=118886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:11:37.316345 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG dbcounter [-] [118886] Writing DB stats nova_cell0:SELECT=3 {{(pid=118886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:11:37.317824 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG dbcounter [-] [118886] Writing DB stats nova_cell0:SELECT=3 {{(pid=118886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:11:37.374664 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG dbcounter [-] [118887] Writing DB stats nova_api:SELECT=3 {{(pid=118887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:11:37.375505 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG dbcounter [-] [118887] Writing DB stats nova_cell1:SELECT=3 {{(pid=118887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:11:37.376773 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG dbcounter [-] [118887] Writing DB stats nova_cell0:SELECT=3 {{(pid=118887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:11:37.377677 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG dbcounter [-] [118887] Writing DB stats nova_cell0:SELECT=3 {{(pid=118887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:11:38.404992 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-397f0704-8eb5-4217-acd8-bd1cebfd07bd tempest-VolumesSnapshotsTestJSON-1898637368 tempest-VolumesSnapshotsTestJSON-1898637368-project] Action: 'create', calling method: .version_select at 0x7fc7027d74c0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-796930947"}} {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:11:38.629876 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-0607217a-1a4b-410a-aad4-170775d6f341 tempest-VolumesGetTestJSON-1758960683 tempest-VolumesGetTestJSON-1758960683-project] Action: 'create', calling method: .version_select at 0x7fc7027d9550>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1365844173", "metadata": {"Type": "work"}}} {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:11:40.209749 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-397f0704-8eb5-4217-acd8-bd1cebfd07bd tempest-VolumesSnapshotsTestJSON-1898637368 tempest-VolumesSnapshotsTestJSON-1898637368-project] 10.222.0.27 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 2.840966 Oct 17 03:11:40.221723 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 1/1] 10.222.0.27 () {60 vars in 1155 bytes} [Mon Oct 17 03:11:37 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 2854 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 17 03:11:40.232097 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-6d2ac54e-f1cc-4dbc-a023-bb46b2a0b807 tempest-VolumesSnapshotsTestJSON-1898637368 tempest-VolumesSnapshotsTestJSON-1898637368-project] Calling method '.version_select at 0x7fc7026ab3a0>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:11:40.320214 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-0607217a-1a4b-410a-aad4-170775d6f341 tempest-VolumesGetTestJSON-1758960683 tempest-VolumesGetTestJSON-1758960683-project] 10.222.0.27 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 3.024672 Oct 17 03:11:40.321257 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 1/2] 10.222.0.27 () {60 vars in 1156 bytes} [Mon Oct 17 03:11:37 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 3029 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 17 03:11:40.349078 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-eeb930c3-1988-4e24-9202-c401aa2cfd2c tempest-VolumesGetTestJSON-1758960683 tempest-VolumesGetTestJSON-1758960683-project] Calling method '.version_select at 0x7fc7026a8430>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:11:40.395104 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-6d2ac54e-f1cc-4dbc-a023-bb46b2a0b807 tempest-VolumesSnapshotsTestJSON-1898637368 tempest-VolumesSnapshotsTestJSON-1898637368-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/f39d4730-f8d7-4abe-990d-f6ba3e686c78" status: 200 len: 344 microversion: 2.1 time: 0.171739 Oct 17 03:11:40.395858 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 2/3] 10.222.0.27 () {58 vars in 1245 bytes} [Mon Oct 17 03:11:40 2022] GET /compute/v2.1/os-volumes/f39d4730-f8d7-4abe-990d-f6ba3e686c78 => generated 344 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:11:40.486232 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-eeb930c3-1988-4e24-9202-c401aa2cfd2c tempest-VolumesGetTestJSON-1758960683 tempest-VolumesGetTestJSON-1758960683-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/160fa5fb-4466-4e08-9dbb-92495eabcfa0" status: 200 len: 353 microversion: 2.1 time: 0.148971 Oct 17 03:11:40.494147 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 2/4] 10.222.0.27 () {58 vars in 1245 bytes} [Mon Oct 17 03:11:40 2022] GET /compute/v2.1/os-volumes/160fa5fb-4466-4e08-9dbb-92495eabcfa0 => generated 353 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:11:41.411004 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-b69f85c4-28a3-4472-8947-0c7ecb93d4c2 tempest-VolumesSnapshotsTestJSON-1898637368 tempest-VolumesSnapshotsTestJSON-1898637368-project] Calling method '.version_select at 0x7fc7026aba60>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:11:41.502565 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-65d49d3c-28f0-4b8c-b9d3-ad94404ad0b1 tempest-VolumesGetTestJSON-1758960683 tempest-VolumesGetTestJSON-1758960683-project] Calling method '.version_select at 0x7fc7026a8af0>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:11:41.529051 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-b69f85c4-28a3-4472-8947-0c7ecb93d4c2 tempest-VolumesSnapshotsTestJSON-1898637368 tempest-VolumesSnapshotsTestJSON-1898637368-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/f39d4730-f8d7-4abe-990d-f6ba3e686c78" status: 200 len: 345 microversion: 2.1 time: 0.123081 Oct 17 03:11:41.529600 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 3/5] 10.222.0.27 () {58 vars in 1245 bytes} [Mon Oct 17 03:11:41 2022] GET /compute/v2.1/os-volumes/f39d4730-f8d7-4abe-990d-f6ba3e686c78 => generated 345 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:11:41.544885 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-ab24706a-99af-4a84-b9c2-506ddefb7290 tempest-VolumesSnapshotsTestJSON-1898637368 tempest-VolumesSnapshotsTestJSON-1898637368-project] Action: 'create', calling method: .version_select at 0x7fc7026450d0>, body: {"snapshot": {"volume_id": "f39d4730-f8d7-4abe-990d-f6ba3e686c78", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1452641890"}} {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:11:41.611289 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-65d49d3c-28f0-4b8c-b9d3-ad94404ad0b1 tempest-VolumesGetTestJSON-1758960683 tempest-VolumesGetTestJSON-1758960683-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/160fa5fb-4466-4e08-9dbb-92495eabcfa0" status: 200 len: 354 microversion: 2.1 time: 0.112186 Oct 17 03:11:41.612130 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 3/6] 10.222.0.27 () {58 vars in 1245 bytes} [Mon Oct 17 03:11:41 2022] GET /compute/v2.1/os-volumes/160fa5fb-4466-4e08-9dbb-92495eabcfa0 => generated 354 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 03:11:41.626921 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-58408cf5-3e2a-4e51-929c-ef1a2d6931b5 tempest-VolumesGetTestJSON-1758960683 tempest-VolumesGetTestJSON-1758960683-project] Calling method '.version_select at 0x7fc7026411f0>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:11:41.729087 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-58408cf5-3e2a-4e51-929c-ef1a2d6931b5 tempest-VolumesGetTestJSON-1758960683 tempest-VolumesGetTestJSON-1758960683-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/160fa5fb-4466-4e08-9dbb-92495eabcfa0" status: 200 len: 354 microversion: 2.1 time: 0.106012 Oct 17 03:11:41.729691 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 4/7] 10.222.0.27 () {58 vars in 1245 bytes} [Mon Oct 17 03:11:41 2022] GET /compute/v2.1/os-volumes/160fa5fb-4466-4e08-9dbb-92495eabcfa0 => generated 354 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:11:41.753770 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-5d1e026f-0bdd-4d69-97cb-babc01093a4f tempest-VolumesGetTestJSON-1758960683 tempest-VolumesGetTestJSON-1758960683-project] Calling method '.version_select at 0x7fc7026a8c10>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:11:41.971284 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-ab24706a-99af-4a84-b9c2-506ddefb7290 tempest-VolumesSnapshotsTestJSON-1898637368 tempest-VolumesSnapshotsTestJSON-1898637368-project] 10.222.0.27 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.430746 Oct 17 03:11:41.972572 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 4/8] 10.222.0.27 () {60 vars in 1162 bytes} [Mon Oct 17 03:11:41 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 03:11:41.985087 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-aa9ab4c1-f2a5-43d0-9faa-8c5eff2a81be tempest-VolumesSnapshotsTestJSON-1898637368 tempest-VolumesSnapshotsTestJSON-1898637368-project] Calling method '.version_select at 0x7fc7026458b0>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:11:42.019202 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-5d1e026f-0bdd-4d69-97cb-babc01093a4f tempest-VolumesGetTestJSON-1758960683 tempest-VolumesGetTestJSON-1758960683-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/160fa5fb-4466-4e08-9dbb-92495eabcfa0" status: 202 len: 0 microversion: 2.1 time: 0.269808 Oct 17 03:11:42.019865 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 5/9] 10.222.0.27 () {58 vars in 1248 bytes} [Mon Oct 17 03:11:41 2022] DELETE /compute/v2.1/os-volumes/160fa5fb-4466-4e08-9dbb-92495eabcfa0 => generated 0 bytes in 271 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 17 03:11:42.029190 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-b5e41f2f-50dd-455a-8316-0a82b44f8759 tempest-VolumesGetTestJSON-1758960683 tempest-VolumesGetTestJSON-1758960683-project] Calling method '.version_select at 0x7fc7026a8550>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:11:42.064937 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-aa9ab4c1-f2a5-43d0-9faa-8c5eff2a81be tempest-VolumesSnapshotsTestJSON-1898637368 tempest-VolumesSnapshotsTestJSON-1898637368-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/f13ada07-710a-4439-9a2c-632fe95aa4fd" status: 200 len: 287 microversion: 2.1 time: 0.083541 Oct 17 03:11:42.065901 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 5/10] 10.222.0.27 () {58 vars in 1251 bytes} [Mon Oct 17 03:11:41 2022] GET /compute/v2.1/os-snapshots/f13ada07-710a-4439-9a2c-632fe95aa4fd => generated 287 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:11:42.080168 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-3cb82ce9-87f1-4dc9-89d3-49612e22a5d4 tempest-VolumesSnapshotsTestJSON-1898637368 tempest-VolumesSnapshotsTestJSON-1898637368-project] Calling method '.version_select at 0x7fc702645040>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:11:42.135132 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-b5e41f2f-50dd-455a-8316-0a82b44f8759 tempest-VolumesGetTestJSON-1758960683 tempest-VolumesGetTestJSON-1758960683-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/160fa5fb-4466-4e08-9dbb-92495eabcfa0" status: 200 len: 353 microversion: 2.1 time: 0.110237 Oct 17 03:11:42.142653 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 6/11] 10.222.0.27 () {58 vars in 1245 bytes} [Mon Oct 17 03:11:42 2022] GET /compute/v2.1/os-volumes/160fa5fb-4466-4e08-9dbb-92495eabcfa0 => generated 353 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:11:42.178026 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-3cb82ce9-87f1-4dc9-89d3-49612e22a5d4 tempest-VolumesSnapshotsTestJSON-1898637368 tempest-VolumesSnapshotsTestJSON-1898637368-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.104246 Oct 17 03:11:42.178668 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 6/12] 10.222.0.27 () {58 vars in 1140 bytes} [Mon Oct 17 03:11:42 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 03:11:42.192005 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-0184c6c4-0533-45b9-9794-c7d52ec694ed tempest-VolumesSnapshotsTestJSON-1898637368 tempest-VolumesSnapshotsTestJSON-1898637368-project] Calling method '.version_select at 0x7fc702641430>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:11:42.293853 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-0184c6c4-0533-45b9-9794-c7d52ec694ed tempest-VolumesSnapshotsTestJSON-1898637368 tempest-VolumesSnapshotsTestJSON-1898637368-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/f13ada07-710a-4439-9a2c-632fe95aa4fd" status: 200 len: 287 microversion: 2.1 time: 0.106513 Oct 17 03:11:42.298983 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 7/13] 10.222.0.27 () {58 vars in 1251 bytes} [Mon Oct 17 03:11:42 2022] GET /compute/v2.1/os-snapshots/f13ada07-710a-4439-9a2c-632fe95aa4fd => generated 287 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:11:43.150197 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-9c9868f8-2ab7-4e3e-ad3f-906b229e21eb tempest-VolumesGetTestJSON-1758960683 tempest-VolumesGetTestJSON-1758960683-project] Calling method '.version_select at 0x7fc7026ab280>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:11:43.247249 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-9c9868f8-2ab7-4e3e-ad3f-906b229e21eb tempest-VolumesGetTestJSON-1758960683 tempest-VolumesGetTestJSON-1758960683-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/160fa5fb-4466-4e08-9dbb-92495eabcfa0" status: 200 len: 353 microversion: 2.1 time: 0.101467 Oct 17 03:11:43.248021 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 7/14] 10.222.0.27 () {58 vars in 1245 bytes} [Mon Oct 17 03:11:43 2022] GET /compute/v2.1/os-volumes/160fa5fb-4466-4e08-9dbb-92495eabcfa0 => generated 353 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:11:43.307395 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-f0bfd390-9fd0-4d8e-a69e-59c0a95c5d7a tempest-VolumesSnapshotsTestJSON-1898637368 tempest-VolumesSnapshotsTestJSON-1898637368-project] Calling method '.version_select at 0x7fc7026a84c0>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:11:43.341706 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-f0bfd390-9fd0-4d8e-a69e-59c0a95c5d7a tempest-VolumesSnapshotsTestJSON-1898637368 tempest-VolumesSnapshotsTestJSON-1898637368-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/f13ada07-710a-4439-9a2c-632fe95aa4fd" status: 200 len: 287 microversion: 2.1 time: 0.038777 Oct 17 03:11:43.342450 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 8/15] 10.222.0.27 () {58 vars in 1251 bytes} [Mon Oct 17 03:11:43 2022] GET /compute/v2.1/os-snapshots/f13ada07-710a-4439-9a2c-632fe95aa4fd => generated 287 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:11:44.263392 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-df091b0b-8aa3-497c-8269-4e564c4f98d0 tempest-VolumesGetTestJSON-1758960683 tempest-VolumesGetTestJSON-1758960683-project] Calling method '.version_select at 0x7fc7026ab9d0>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:11:44.367769 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-10b94575-d393-4efd-8ebf-64d3d2df982a tempest-VolumesSnapshotsTestJSON-1898637368 tempest-VolumesSnapshotsTestJSON-1898637368-project] Calling method '.version_select at 0x7fc7026a8b80>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:11:44.447695 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-10b94575-d393-4efd-8ebf-64d3d2df982a tempest-VolumesSnapshotsTestJSON-1898637368 tempest-VolumesSnapshotsTestJSON-1898637368-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/f13ada07-710a-4439-9a2c-632fe95aa4fd" status: 200 len: 287 microversion: 2.1 time: 0.097245 Oct 17 03:11:44.454672 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 9/16] 10.222.0.27 () {58 vars in 1251 bytes} [Mon Oct 17 03:11:44 2022] GET /compute/v2.1/os-snapshots/f13ada07-710a-4439-9a2c-632fe95aa4fd => generated 287 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:11:44.597310 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-df091b0b-8aa3-497c-8269-4e564c4f98d0 tempest-VolumesGetTestJSON-1758960683 tempest-VolumesGetTestJSON-1758960683-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/160fa5fb-4466-4e08-9dbb-92495eabcfa0" status: 200 len: 353 microversion: 2.1 time: 0.337447 Oct 17 03:11:44.597696 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 8/17] 10.222.0.27 () {58 vars in 1245 bytes} [Mon Oct 17 03:11:44 2022] GET /compute/v2.1/os-volumes/160fa5fb-4466-4e08-9dbb-92495eabcfa0 => generated 353 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:11:45.462310 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-97eb3655-c20b-48c1-acec-e4cafa385b1f tempest-VolumesSnapshotsTestJSON-1898637368 tempest-VolumesSnapshotsTestJSON-1898637368-project] Calling method '.version_select at 0x7fc702641820>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:11:45.554361 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-97eb3655-c20b-48c1-acec-e4cafa385b1f tempest-VolumesSnapshotsTestJSON-1898637368 tempest-VolumesSnapshotsTestJSON-1898637368-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/f13ada07-710a-4439-9a2c-632fe95aa4fd" status: 200 len: 288 microversion: 2.1 time: 0.096330 Oct 17 03:11:45.554950 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 10/18] 10.222.0.27 () {58 vars in 1251 bytes} [Mon Oct 17 03:11:45 2022] GET /compute/v2.1/os-snapshots/f13ada07-710a-4439-9a2c-632fe95aa4fd => generated 288 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:11:45.568303 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-36156581-873b-45e1-b8a7-d3e8d3058c48 tempest-VolumesSnapshotsTestJSON-1898637368 tempest-VolumesSnapshotsTestJSON-1898637368-project] Calling method '.version_select at 0x7fc703004a60>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:11:45.613665 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-4cd4e030-fc0b-4b6c-8ad7-e4c99e80d8df tempest-VolumesGetTestJSON-1758960683 tempest-VolumesGetTestJSON-1758960683-project] Calling method '.version_select at 0x7fc7026a8c10>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:11:45.681968 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.wsgi [None req-4cd4e030-fc0b-4b6c-8ad7-e4c99e80d8df tempest-VolumesGetTestJSON-1758960683 tempest-VolumesGetTestJSON-1758960683-project] HTTP exception thrown: Volume 160fa5fb-4466-4e08-9dbb-92495eabcfa0 could not be found. Oct 17 03:11:45.688012 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-4cd4e030-fc0b-4b6c-8ad7-e4c99e80d8df tempest-VolumesGetTestJSON-1758960683 tempest-VolumesGetTestJSON-1758960683-project] Request method failure captured: Oct 17 03:11:45.688012 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: request: GET /compute/v2.1/os-volumes/160fa5fb-4466-4e08-9dbb-92495eabcfa0 HTTP/1.1 Oct 17 03:11:45.688012 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Accept: application/json Oct 17 03:11:45.688012 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Accept-Encoding: identity Oct 17 03:11:45.688012 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Connection: close Oct 17 03:11:45.688012 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Content-Length: 0 Oct 17 03:11:45.688012 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Content-Type: application/json Oct 17 03:11:45.688012 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Host: 10.222.0.27 Oct 17 03:11:45.688012 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Openstack-System-Scope: None Oct 17 03:11:45.688012 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: User-Agent: python-urllib3/1.26.12 Oct 17 03:11:45.688012 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Auth-Token: gAAAAABjTMfp3KJWfIRJKYVz5dIdTSO0scYZljDfzBWnmz7dQikj_vN-h765JzwcEedT1PrGZOUuoTEbFbElSeWeNFncQDfGBpjaApTDIBrpJLl-iMtpCoXN0sn52_O6d-SXnz6FygbDne_x92vkeSv0ySAF0WccboVhRthSwuR9Quw20VD-gS0 Oct 17 03:11:45.688012 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Domain-Id: None Oct 17 03:11:45.688012 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Domain-Name: None Oct 17 03:11:45.688012 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Identity-Status: Confirmed Oct 17 03:11:45.688012 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Is-Admin-Project: True Oct 17 03:11:45.688012 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Project-Domain-Id: default Oct 17 03:11:45.688012 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Project-Domain-Name: Default Oct 17 03:11:45.688012 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Project-Id: 0ef53dd7ed7445d1ad4736c110b85f67 Oct 17 03:11:45.688012 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Project-Name: tempest-VolumesGetTestJSON-1758960683 Oct 17 03:11:45.688012 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Role: member,reader Oct 17 03:11:45.688012 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Roles: member,reader Oct 17 03:11:45.689667 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0ef53dd7ed7445d1ad4736c110b85f67"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0ef53dd7ed7445d1ad4736c110b85f67"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0ef53dd7ed7445d1ad4736c110b85f67"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0ef53dd7ed7445d1ad4736c110b85f67"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 17 03:11:45.689667 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Tenant: tempest-VolumesGetTestJSON-1758960683 Oct 17 03:11:45.689667 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Tenant-Id: 0ef53dd7ed7445d1ad4736c110b85f67 Oct 17 03:11:45.689667 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Tenant-Name: tempest-VolumesGetTestJSON-1758960683 Oct 17 03:11:45.689667 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-User: tempest-VolumesGetTestJSON-1758960683-project Oct 17 03:11:45.689667 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-User-Domain-Id: default Oct 17 03:11:45.689667 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-User-Domain-Name: Default Oct 17 03:11:45.689667 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-User-Id: b81dd89ceab4437495b3beca56353d4f Oct 17 03:11:45.689667 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-User-Name: tempest-VolumesGetTestJSON-1758960683-project Oct 17 03:11:45.689667 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: method: Oct 17 03:11:45.689667 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: exception: Volume 160fa5fb-4466-4e08-9dbb-92495eabcfa0 could not be found. Oct 17 03:11:45.689667 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: action_args: {'id': '160fa5fb-4466-4e08-9dbb-92495eabcfa0'} Oct 17 03:11:45.689667 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 03:11:45.690496 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:11:45.690496 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 17 03:11:45.690496 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 17 03:11:45.690496 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 17 03:11:45.690496 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 17 03:11:45.690496 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 17 03:11:45.690496 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 17 03:11:45.690496 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 17 03:11:45.690496 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 17 03:11:45.690496 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 17 03:11:45.690496 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 17 03:11:45.690496 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 03:11:45.690496 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 03:11:45.690496 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 03:11:45.690496 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 03:11:45.690496 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 160fa5fb-4466-4e08-9dbb-92495eabcfa0 could not be found. (HTTP 404) (Request-ID: req-fae53e51-fe4f-4b21-a2b4-32ee91fe18ee) Oct 17 03:11:45.690496 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Oct 17 03:11:45.690496 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:11:45.690496 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Oct 17 03:11:45.691789 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:11:45.691789 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 17 03:11:45.691789 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 17 03:11:45.691789 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 17 03:11:45.691789 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 17 03:11:45.691789 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 17 03:11:45.691789 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 17 03:11:45.691789 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 17 03:11:45.691789 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 17 03:11:45.691789 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 17 03:11:45.691789 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 17 03:11:45.691789 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 17 03:11:45.691789 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 17 03:11:45.691789 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 17 03:11:45.691789 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 17 03:11:45.691789 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 17 03:11:45.691789 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 17 03:11:45.691789 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 17 03:11:45.691789 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 17 03:11:45.693536 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 03:11:45.693536 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 03:11:45.693536 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 03:11:45.693536 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 03:11:45.693536 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 160fa5fb-4466-4e08-9dbb-92495eabcfa0 could not be found. Oct 17 03:11:45.693536 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Oct 17 03:11:45.693536 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:11:45.693536 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Oct 17 03:11:45.693536 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:11:45.693536 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:11:45.693536 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:11:45.693536 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 03:11:45.693536 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 03:11:45.693536 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 03:11:45.693536 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 03:11:45.693536 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 03:11:45.693536 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 03:11:45.693536 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 17 03:11:45.693536 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 03:11:45.694839 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 160fa5fb-4466-4e08-9dbb-92495eabcfa0 could not be found. Oct 17 03:11:45.694839 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Oct 17 03:11:45.694839 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:11:45.694839 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Oct 17 03:11:45.694839 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:11:45.694839 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:11:45.694839 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:11:45.694839 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 03:11:45.694839 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 03:11:45.694839 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 160fa5fb-4466-4e08-9dbb-92495eabcfa0 could not be found. Oct 17 03:11:45.694839 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Oct 17 03:11:45.694839 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-4cd4e030-fc0b-4b6c-8ad7-e4c99e80d8df tempest-VolumesGetTestJSON-1758960683 tempest-VolumesGetTestJSON-1758960683-project] Returning 404 to user: Volume 160fa5fb-4466-4e08-9dbb-92495eabcfa0 could not be found. {{(pid=118886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 03:11:45.694839 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-4cd4e030-fc0b-4b6c-8ad7-e4c99e80d8df tempest-VolumesGetTestJSON-1758960683 tempest-VolumesGetTestJSON-1758960683-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/160fa5fb-4466-4e08-9dbb-92495eabcfa0" status: 404 len: 109 microversion: 2.1 time: 0.086628 Oct 17 03:11:45.701953 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 11/19] 10.222.0.27 () {58 vars in 1245 bytes} [Mon Oct 17 03:11:45 2022] GET /compute/v2.1/os-volumes/160fa5fb-4466-4e08-9dbb-92495eabcfa0 => generated 109 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 03:11:45.743553 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-36156581-873b-45e1-b8a7-d3e8d3058c48 tempest-VolumesSnapshotsTestJSON-1898637368 tempest-VolumesSnapshotsTestJSON-1898637368-project] 10.222.0.27 "DELETE /compute/v2.1/os-snapshots/f13ada07-710a-4439-9a2c-632fe95aa4fd" status: 202 len: 0 microversion: 2.1 time: 0.180553 Oct 17 03:11:45.744821 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 9/20] 10.222.0.27 () {58 vars in 1254 bytes} [Mon Oct 17 03:11:45 2022] DELETE /compute/v2.1/os-snapshots/f13ada07-710a-4439-9a2c-632fe95aa4fd => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 03:11:45.755496 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-5bae997c-983f-4ea5-80dc-170a4227ad86 tempest-VolumesSnapshotsTestJSON-1898637368 tempest-VolumesSnapshotsTestJSON-1898637368-project] Calling method '.version_select at 0x7fc703004af0>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:11:45.845576 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-5bae997c-983f-4ea5-80dc-170a4227ad86 tempest-VolumesSnapshotsTestJSON-1898637368 tempest-VolumesSnapshotsTestJSON-1898637368-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/f13ada07-710a-4439-9a2c-632fe95aa4fd" status: 200 len: 287 microversion: 2.1 time: 0.096487 Oct 17 03:11:45.846385 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 12/21] 10.222.0.27 () {58 vars in 1251 bytes} [Mon Oct 17 03:11:45 2022] GET /compute/v2.1/os-snapshots/f13ada07-710a-4439-9a2c-632fe95aa4fd => generated 287 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:11:46.860210 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-7c57eda5-0c3b-41cf-92b5-a50c04fcae0f tempest-VolumesSnapshotsTestJSON-1898637368 tempest-VolumesSnapshotsTestJSON-1898637368-project] Calling method '.version_select at 0x7fc702645ca0>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:11:46.930578 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.wsgi [None req-7c57eda5-0c3b-41cf-92b5-a50c04fcae0f tempest-VolumesSnapshotsTestJSON-1898637368 tempest-VolumesSnapshotsTestJSON-1898637368-project] HTTP exception thrown: Snapshot f13ada07-710a-4439-9a2c-632fe95aa4fd could not be found. Oct 17 03:11:46.935171 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-7c57eda5-0c3b-41cf-92b5-a50c04fcae0f tempest-VolumesSnapshotsTestJSON-1898637368 tempest-VolumesSnapshotsTestJSON-1898637368-project] Request method failure captured: Oct 17 03:11:46.935171 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: request: GET /compute/v2.1/os-snapshots/f13ada07-710a-4439-9a2c-632fe95aa4fd HTTP/1.1 Oct 17 03:11:46.935171 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Accept: application/json Oct 17 03:11:46.935171 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Accept-Encoding: identity Oct 17 03:11:46.935171 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Connection: close Oct 17 03:11:46.935171 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Content-Length: 0 Oct 17 03:11:46.935171 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Content-Type: application/json Oct 17 03:11:46.935171 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Host: 10.222.0.27 Oct 17 03:11:46.935171 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Openstack-System-Scope: None Oct 17 03:11:46.935171 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: User-Agent: python-urllib3/1.26.12 Oct 17 03:11:46.935171 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Auth-Token: gAAAAABjTMfpfDihG65aQcpsSso6vn_C1g-QHbGtnBNga737Wu7ZbiaYwCZnWLiu0TCW9ykQGIfMILfetTqZAR-NvheAfexyv1SHcTqmXks7a1antYcnAZidCSvONS7yM5xJ1qxifHTjgDLzsjBkLSQEkNrYUF3ZD_r-w7uZKHDT4DuRYLpdnqg Oct 17 03:11:46.935171 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Domain-Id: None Oct 17 03:11:46.935171 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Domain-Name: None Oct 17 03:11:46.935171 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Identity-Status: Confirmed Oct 17 03:11:46.935171 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Is-Admin-Project: True Oct 17 03:11:46.935171 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Project-Domain-Id: default Oct 17 03:11:46.935171 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Project-Domain-Name: Default Oct 17 03:11:46.935171 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Project-Id: 2867761270a140818364c8e25f2df0e4 Oct 17 03:11:46.935171 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1898637368 Oct 17 03:11:46.935171 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Role: member,reader Oct 17 03:11:46.935171 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Roles: member,reader Oct 17 03:11:46.936596 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2867761270a140818364c8e25f2df0e4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2867761270a140818364c8e25f2df0e4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2867761270a140818364c8e25f2df0e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2867761270a140818364c8e25f2df0e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 17 03:11:46.936596 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1898637368 Oct 17 03:11:46.936596 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Tenant-Id: 2867761270a140818364c8e25f2df0e4 Oct 17 03:11:46.936596 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1898637368 Oct 17 03:11:46.936596 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-User: tempest-VolumesSnapshotsTestJSON-1898637368-project Oct 17 03:11:46.936596 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-User-Domain-Id: default Oct 17 03:11:46.936596 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-User-Domain-Name: Default Oct 17 03:11:46.936596 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-User-Id: 9de79389028d4ebfa448de34193f74f8 Oct 17 03:11:46.936596 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1898637368-project Oct 17 03:11:46.936596 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: method: Oct 17 03:11:46.936596 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: exception: Snapshot f13ada07-710a-4439-9a2c-632fe95aa4fd could not be found. Oct 17 03:11:46.936596 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: action_args: {'id': 'f13ada07-710a-4439-9a2c-632fe95aa4fd'} Oct 17 03:11:46.936596 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 03:11:46.937755 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:11:46.937755 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 17 03:11:46.937755 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 17 03:11:46.937755 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 17 03:11:46.937755 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 17 03:11:46.937755 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 17 03:11:46.937755 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 17 03:11:46.937755 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 17 03:11:46.937755 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 17 03:11:46.937755 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 17 03:11:46.937755 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 17 03:11:46.937755 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 03:11:46.937755 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 03:11:46.937755 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 03:11:46.937755 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 03:11:46.937755 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot f13ada07-710a-4439-9a2c-632fe95aa4fd could not be found. (HTTP 404) (Request-ID: req-fc3b532d-38a1-406a-a5de-e83a8c6c491d) Oct 17 03:11:46.937755 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Oct 17 03:11:46.937755 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:11:46.940544 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Oct 17 03:11:46.940544 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:11:46.940544 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Oct 17 03:11:46.940544 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Oct 17 03:11:46.940544 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 17 03:11:46.940544 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 17 03:11:46.940544 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Oct 17 03:11:46.940544 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Oct 17 03:11:46.940544 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 17 03:11:46.940544 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 17 03:11:46.940544 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 17 03:11:46.940544 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 17 03:11:46.940544 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 17 03:11:46.940544 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 17 03:11:46.940544 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 17 03:11:46.940544 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 17 03:11:46.940544 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 17 03:11:46.940544 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 17 03:11:46.940544 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 17 03:11:46.941897 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 17 03:11:46.941897 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 03:11:46.941897 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 03:11:46.941897 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 03:11:46.941897 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 03:11:46.941897 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot f13ada07-710a-4439-9a2c-632fe95aa4fd could not be found. Oct 17 03:11:46.941897 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Oct 17 03:11:46.941897 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:11:46.941897 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Oct 17 03:11:46.941897 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:11:46.941897 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:11:46.941897 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:11:46.941897 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 03:11:46.941897 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 03:11:46.941897 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 03:11:46.941897 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 03:11:46.941897 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 03:11:46.941897 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 03:11:46.941897 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Oct 17 03:11:46.941897 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 03:11:46.944086 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot f13ada07-710a-4439-9a2c-632fe95aa4fd could not be found. Oct 17 03:11:46.944086 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Oct 17 03:11:46.944086 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:11:46.944086 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Oct 17 03:11:46.944086 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:11:46.944086 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:11:46.944086 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:11:46.944086 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 03:11:46.944086 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 03:11:46.944086 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot f13ada07-710a-4439-9a2c-632fe95aa4fd could not be found. Oct 17 03:11:46.944086 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Oct 17 03:11:46.944086 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-7c57eda5-0c3b-41cf-92b5-a50c04fcae0f tempest-VolumesSnapshotsTestJSON-1898637368 tempest-VolumesSnapshotsTestJSON-1898637368-project] Returning 404 to user: Snapshot f13ada07-710a-4439-9a2c-632fe95aa4fd could not be found. {{(pid=118887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 03:11:46.944086 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-7c57eda5-0c3b-41cf-92b5-a50c04fcae0f tempest-VolumesSnapshotsTestJSON-1898637368 tempest-VolumesSnapshotsTestJSON-1898637368-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/f13ada07-710a-4439-9a2c-632fe95aa4fd" status: 404 len: 111 microversion: 2.1 time: 0.081565 Oct 17 03:11:46.945649 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 10/22] 10.222.0.27 () {58 vars in 1251 bytes} [Mon Oct 17 03:11:46 2022] GET /compute/v2.1/os-snapshots/f13ada07-710a-4439-9a2c-632fe95aa4fd => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 03:11:46.946313 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-cf1afe45-ce6d-49c1-9dc2-c7d75a370e9e tempest-VolumesSnapshotsTestJSON-1898637368 tempest-VolumesSnapshotsTestJSON-1898637368-project] Calling method '.version_select at 0x7fc7026a8e50>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:11:47.075420 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-cf1afe45-ce6d-49c1-9dc2-c7d75a370e9e tempest-VolumesSnapshotsTestJSON-1898637368 tempest-VolumesSnapshotsTestJSON-1898637368-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/f39d4730-f8d7-4abe-990d-f6ba3e686c78" status: 202 len: 0 microversion: 2.1 time: 0.133124 Oct 17 03:11:47.076082 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 13/23] 10.222.0.27 () {58 vars in 1248 bytes} [Mon Oct 17 03:11:46 2022] DELETE /compute/v2.1/os-volumes/f39d4730-f8d7-4abe-990d-f6ba3e686c78 => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 03:11:47.096117 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-a704e996-5621-488d-9e9f-2af0d56e3baf tempest-VolumesSnapshotsTestJSON-1898637368 tempest-VolumesSnapshotsTestJSON-1898637368-project] Calling method '.version_select at 0x7fc702645b80>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:11:47.263603 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-a704e996-5621-488d-9e9f-2af0d56e3baf tempest-VolumesSnapshotsTestJSON-1898637368 tempest-VolumesSnapshotsTestJSON-1898637368-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/f39d4730-f8d7-4abe-990d-f6ba3e686c78" status: 200 len: 344 microversion: 2.1 time: 0.181820 Oct 17 03:11:47.264423 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 11/24] 10.222.0.27 () {58 vars in 1245 bytes} [Mon Oct 17 03:11:47 2022] GET /compute/v2.1/os-volumes/f39d4730-f8d7-4abe-990d-f6ba3e686c78 => generated 344 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 03:11:47.795419 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-b7728269-efd2-433d-b3cc-5c9c175f4fe8 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Action: 'create', calling method: .version_select at 0x7fc70262d430>, body: {"keypair": {"name": "tempest-keypair-1868694485", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH1X3c972dd0grN4Zde6f3PDCUUOvYWlB3OghIAJxjUqX9zrsQg1tjMMJWgrhYQ3p2gAbxgb6xxcsI0XdIIVP6yjNsMfnjrKUPw03MmhQGVVk+Aiz51RdD5aAmS3AKaPCg=="}} {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:11:47.935178 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.quota [None req-b7728269-efd2-433d-b3cc-5c9c175f4fe8 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Getting quotas for project 36f63b28bb4f4654b53a01507b337d52. Resources: {'key_pairs'} {{(pid=118886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 03:11:47.968494 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.quota [None req-b7728269-efd2-433d-b3cc-5c9c175f4fe8 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Getting quotas for user 37e6d36d529146299970874660e92e43 and project 36f63b28bb4f4654b53a01507b337d52. Resources: {'key_pairs'} {{(pid=118886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 03:11:48.074255 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-b7728269-efd2-433d-b3cc-5c9c175f4fe8 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.786747 Oct 17 03:11:48.083206 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 14/25] 10.222.0.27 () {62 vars in 1200 bytes} [Mon Oct 17 03:11:47 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 789 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 17 03:11:48.279774 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-5843ab7d-481a-447a-b367-d816ece73279 tempest-VolumesSnapshotsTestJSON-1898637368 tempest-VolumesSnapshotsTestJSON-1898637368-project] Calling method '.version_select at 0x7fc70262a430>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:11:48.343477 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.wsgi [None req-5843ab7d-481a-447a-b367-d816ece73279 tempest-VolumesSnapshotsTestJSON-1898637368 tempest-VolumesSnapshotsTestJSON-1898637368-project] HTTP exception thrown: Volume f39d4730-f8d7-4abe-990d-f6ba3e686c78 could not be found. Oct 17 03:11:48.347313 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-5843ab7d-481a-447a-b367-d816ece73279 tempest-VolumesSnapshotsTestJSON-1898637368 tempest-VolumesSnapshotsTestJSON-1898637368-project] Request method failure captured: Oct 17 03:11:48.347313 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: request: GET /compute/v2.1/os-volumes/f39d4730-f8d7-4abe-990d-f6ba3e686c78 HTTP/1.1 Oct 17 03:11:48.347313 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Accept: application/json Oct 17 03:11:48.347313 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Accept-Encoding: identity Oct 17 03:11:48.347313 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Connection: close Oct 17 03:11:48.347313 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Content-Length: 0 Oct 17 03:11:48.347313 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Content-Type: application/json Oct 17 03:11:48.347313 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Host: 10.222.0.27 Oct 17 03:11:48.347313 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Openstack-System-Scope: None Oct 17 03:11:48.347313 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: User-Agent: python-urllib3/1.26.12 Oct 17 03:11:48.347313 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Auth-Token: gAAAAABjTMfpfDihG65aQcpsSso6vn_C1g-QHbGtnBNga737Wu7ZbiaYwCZnWLiu0TCW9ykQGIfMILfetTqZAR-NvheAfexyv1SHcTqmXks7a1antYcnAZidCSvONS7yM5xJ1qxifHTjgDLzsjBkLSQEkNrYUF3ZD_r-w7uZKHDT4DuRYLpdnqg Oct 17 03:11:48.347313 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Domain-Id: None Oct 17 03:11:48.347313 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Domain-Name: None Oct 17 03:11:48.347313 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Identity-Status: Confirmed Oct 17 03:11:48.347313 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Is-Admin-Project: True Oct 17 03:11:48.347313 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Project-Domain-Id: default Oct 17 03:11:48.347313 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Project-Domain-Name: Default Oct 17 03:11:48.347313 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Project-Id: 2867761270a140818364c8e25f2df0e4 Oct 17 03:11:48.347313 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1898637368 Oct 17 03:11:48.347313 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Role: member,reader Oct 17 03:11:48.347313 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Roles: member,reader Oct 17 03:11:48.348653 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2867761270a140818364c8e25f2df0e4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2867761270a140818364c8e25f2df0e4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2867761270a140818364c8e25f2df0e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2867761270a140818364c8e25f2df0e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 17 03:11:48.348653 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1898637368 Oct 17 03:11:48.348653 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Tenant-Id: 2867761270a140818364c8e25f2df0e4 Oct 17 03:11:48.348653 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1898637368 Oct 17 03:11:48.348653 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-User: tempest-VolumesSnapshotsTestJSON-1898637368-project Oct 17 03:11:48.348653 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-User-Domain-Id: default Oct 17 03:11:48.348653 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-User-Domain-Name: Default Oct 17 03:11:48.348653 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-User-Id: 9de79389028d4ebfa448de34193f74f8 Oct 17 03:11:48.348653 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1898637368-project Oct 17 03:11:48.348653 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: method: Oct 17 03:11:48.348653 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: exception: Volume f39d4730-f8d7-4abe-990d-f6ba3e686c78 could not be found. Oct 17 03:11:48.348653 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: action_args: {'id': 'f39d4730-f8d7-4abe-990d-f6ba3e686c78'} Oct 17 03:11:48.348653 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 03:11:48.349522 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:11:48.349522 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 17 03:11:48.349522 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 17 03:11:48.349522 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 17 03:11:48.349522 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 17 03:11:48.349522 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 17 03:11:48.349522 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 17 03:11:48.349522 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 17 03:11:48.349522 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 17 03:11:48.349522 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 17 03:11:48.349522 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 17 03:11:48.349522 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 03:11:48.349522 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 03:11:48.349522 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 03:11:48.349522 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 03:11:48.349522 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f39d4730-f8d7-4abe-990d-f6ba3e686c78 could not be found. (HTTP 404) (Request-ID: req-95373d87-8076-4959-8492-944d7c072443) Oct 17 03:11:48.349522 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Oct 17 03:11:48.349522 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:11:48.349522 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Oct 17 03:11:48.350921 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:11:48.350921 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 17 03:11:48.350921 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 17 03:11:48.350921 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 17 03:11:48.350921 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 17 03:11:48.350921 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 17 03:11:48.350921 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 17 03:11:48.350921 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 17 03:11:48.350921 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 17 03:11:48.350921 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 17 03:11:48.350921 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 17 03:11:48.350921 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 17 03:11:48.350921 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 17 03:11:48.350921 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 17 03:11:48.350921 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 17 03:11:48.350921 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 17 03:11:48.350921 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 17 03:11:48.350921 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 17 03:11:48.350921 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 17 03:11:48.352426 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 03:11:48.352426 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 03:11:48.352426 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 03:11:48.352426 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 03:11:48.352426 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f39d4730-f8d7-4abe-990d-f6ba3e686c78 could not be found. Oct 17 03:11:48.352426 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Oct 17 03:11:48.352426 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:11:48.352426 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Oct 17 03:11:48.352426 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:11:48.352426 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:11:48.352426 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:11:48.352426 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 03:11:48.352426 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 03:11:48.352426 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 03:11:48.352426 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 03:11:48.352426 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 03:11:48.352426 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 03:11:48.352426 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 17 03:11:48.352426 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 03:11:48.353645 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f39d4730-f8d7-4abe-990d-f6ba3e686c78 could not be found. Oct 17 03:11:48.353645 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Oct 17 03:11:48.353645 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:11:48.353645 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Oct 17 03:11:48.353645 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:11:48.353645 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:11:48.353645 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:11:48.353645 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 03:11:48.353645 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 03:11:48.353645 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f39d4730-f8d7-4abe-990d-f6ba3e686c78 could not be found. Oct 17 03:11:48.353645 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Oct 17 03:11:48.360224 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-5843ab7d-481a-447a-b367-d816ece73279 tempest-VolumesSnapshotsTestJSON-1898637368 tempest-VolumesSnapshotsTestJSON-1898637368-project] Returning 404 to user: Volume f39d4730-f8d7-4abe-990d-f6ba3e686c78 could not be found. {{(pid=118887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 03:11:48.361379 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-5843ab7d-481a-447a-b367-d816ece73279 tempest-VolumesSnapshotsTestJSON-1898637368 tempest-VolumesSnapshotsTestJSON-1898637368-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/f39d4730-f8d7-4abe-990d-f6ba3e686c78" status: 404 len: 109 microversion: 2.1 time: 0.085980 Oct 17 03:11:48.362194 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 12/26] 10.222.0.27 () {58 vars in 1245 bytes} [Mon Oct 17 03:11:48 2022] GET /compute/v2.1/os-volumes/f39d4730-f8d7-4abe-990d-f6ba3e686c78 => generated 109 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 03:11:48.377299 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-990b2a8e-3481-4eb3-b0af-6e68c642ac0f tempest-VolumesSnapshotsTestJSON-1898637368 tempest-VolumesSnapshotsTestJSON-1898637368-project] Calling method '.version_select at 0x7fc702582a60>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:11:48.437639 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.wsgi [None req-990b2a8e-3481-4eb3-b0af-6e68c642ac0f tempest-VolumesSnapshotsTestJSON-1898637368 tempest-VolumesSnapshotsTestJSON-1898637368-project] HTTP exception thrown: Volume f39d4730-f8d7-4abe-990d-f6ba3e686c78 could not be found. Oct 17 03:11:48.440123 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-990b2a8e-3481-4eb3-b0af-6e68c642ac0f tempest-VolumesSnapshotsTestJSON-1898637368 tempest-VolumesSnapshotsTestJSON-1898637368-project] Request method failure captured: Oct 17 03:11:48.440123 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: request: DELETE /compute/v2.1/os-volumes/f39d4730-f8d7-4abe-990d-f6ba3e686c78 HTTP/1.1 Oct 17 03:11:48.440123 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Accept: application/json Oct 17 03:11:48.440123 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Accept-Encoding: identity Oct 17 03:11:48.440123 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Connection: close Oct 17 03:11:48.440123 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Content-Length: 0 Oct 17 03:11:48.440123 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Content-Type: application/json Oct 17 03:11:48.440123 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Host: 10.222.0.27 Oct 17 03:11:48.440123 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Openstack-System-Scope: None Oct 17 03:11:48.440123 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: User-Agent: python-urllib3/1.26.12 Oct 17 03:11:48.440123 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Auth-Token: gAAAAABjTMfpfDihG65aQcpsSso6vn_C1g-QHbGtnBNga737Wu7ZbiaYwCZnWLiu0TCW9ykQGIfMILfetTqZAR-NvheAfexyv1SHcTqmXks7a1antYcnAZidCSvONS7yM5xJ1qxifHTjgDLzsjBkLSQEkNrYUF3ZD_r-w7uZKHDT4DuRYLpdnqg Oct 17 03:11:48.440123 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Domain-Id: None Oct 17 03:11:48.440123 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Domain-Name: None Oct 17 03:11:48.440123 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Identity-Status: Confirmed Oct 17 03:11:48.440123 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Is-Admin-Project: True Oct 17 03:11:48.440123 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Project-Domain-Id: default Oct 17 03:11:48.440123 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Project-Domain-Name: Default Oct 17 03:11:48.440123 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Project-Id: 2867761270a140818364c8e25f2df0e4 Oct 17 03:11:48.440123 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1898637368 Oct 17 03:11:48.440123 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Role: member,reader Oct 17 03:11:48.440123 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Roles: member,reader Oct 17 03:11:48.441423 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2867761270a140818364c8e25f2df0e4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2867761270a140818364c8e25f2df0e4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2867761270a140818364c8e25f2df0e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2867761270a140818364c8e25f2df0e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 17 03:11:48.441423 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1898637368 Oct 17 03:11:48.441423 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Tenant-Id: 2867761270a140818364c8e25f2df0e4 Oct 17 03:11:48.441423 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1898637368 Oct 17 03:11:48.441423 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-User: tempest-VolumesSnapshotsTestJSON-1898637368-project Oct 17 03:11:48.441423 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-User-Domain-Id: default Oct 17 03:11:48.441423 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-User-Domain-Name: Default Oct 17 03:11:48.441423 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-User-Id: 9de79389028d4ebfa448de34193f74f8 Oct 17 03:11:48.441423 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1898637368-project Oct 17 03:11:48.441423 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: method: Oct 17 03:11:48.441423 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: exception: Volume f39d4730-f8d7-4abe-990d-f6ba3e686c78 could not be found. Oct 17 03:11:48.441423 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: action_args: {'id': 'f39d4730-f8d7-4abe-990d-f6ba3e686c78'} Oct 17 03:11:48.441423 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 03:11:48.442211 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:11:48.442211 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 17 03:11:48.442211 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 17 03:11:48.442211 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 17 03:11:48.442211 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 17 03:11:48.442211 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 17 03:11:48.442211 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 17 03:11:48.442211 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 17 03:11:48.442211 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 17 03:11:48.442211 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 17 03:11:48.442211 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 17 03:11:48.442211 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 03:11:48.442211 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 03:11:48.442211 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 03:11:48.442211 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 03:11:48.442211 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f39d4730-f8d7-4abe-990d-f6ba3e686c78 could not be found. (HTTP 404) (Request-ID: req-4dcf3695-0903-4894-9ae6-91a77f162803) Oct 17 03:11:48.442211 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Oct 17 03:11:48.442211 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:11:48.442211 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Oct 17 03:11:48.443390 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:11:48.443390 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 17 03:11:48.443390 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 17 03:11:48.443390 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 17 03:11:48.443390 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 17 03:11:48.443390 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 17 03:11:48.443390 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 17 03:11:48.443390 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 17 03:11:48.443390 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 17 03:11:48.443390 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 17 03:11:48.443390 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 17 03:11:48.443390 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 17 03:11:48.443390 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 17 03:11:48.443390 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 17 03:11:48.443390 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 17 03:11:48.443390 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 17 03:11:48.443390 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 17 03:11:48.443390 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 17 03:11:48.443390 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 17 03:11:48.444510 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 03:11:48.444510 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 03:11:48.444510 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 03:11:48.444510 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 03:11:48.444510 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f39d4730-f8d7-4abe-990d-f6ba3e686c78 could not be found. Oct 17 03:11:48.444510 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Oct 17 03:11:48.444510 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:11:48.444510 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Oct 17 03:11:48.444510 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:11:48.444510 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:11:48.444510 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:11:48.444510 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 03:11:48.444510 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 03:11:48.444510 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 03:11:48.444510 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 03:11:48.444510 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 03:11:48.444510 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 03:11:48.444510 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 17 03:11:48.444510 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 03:11:48.447409 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f39d4730-f8d7-4abe-990d-f6ba3e686c78 could not be found. Oct 17 03:11:48.447409 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Oct 17 03:11:48.447409 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:11:48.447409 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Oct 17 03:11:48.447409 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:11:48.447409 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:11:48.447409 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:11:48.447409 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 03:11:48.447409 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 03:11:48.447409 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f39d4730-f8d7-4abe-990d-f6ba3e686c78 could not be found. Oct 17 03:11:48.447409 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Oct 17 03:11:48.447409 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-990b2a8e-3481-4eb3-b0af-6e68c642ac0f tempest-VolumesSnapshotsTestJSON-1898637368 tempest-VolumesSnapshotsTestJSON-1898637368-project] Returning 404 to user: Volume f39d4730-f8d7-4abe-990d-f6ba3e686c78 could not be found. {{(pid=118886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 03:11:48.447409 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-990b2a8e-3481-4eb3-b0af-6e68c642ac0f tempest-VolumesSnapshotsTestJSON-1898637368 tempest-VolumesSnapshotsTestJSON-1898637368-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/f39d4730-f8d7-4abe-990d-f6ba3e686c78" status: 404 len: 109 microversion: 2.1 time: 0.069160 Oct 17 03:11:48.447409 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 15/27] 10.222.0.27 () {58 vars in 1248 bytes} [Mon Oct 17 03:11:48 2022] DELETE /compute/v2.1/os-volumes/f39d4730-f8d7-4abe-990d-f6ba3e686c78 => generated 109 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 03:11:48.452337 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-0f73789f-f601-4ab2-845c-1bf4d7f3dfdc tempest-VolumesSnapshotsTestJSON-1898637368 tempest-VolumesSnapshotsTestJSON-1898637368-project] Calling method '.version_select at 0x7fc7027d75e0>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:11:48.521568 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.wsgi [None req-0f73789f-f601-4ab2-845c-1bf4d7f3dfdc tempest-VolumesSnapshotsTestJSON-1898637368 tempest-VolumesSnapshotsTestJSON-1898637368-project] HTTP exception thrown: Volume f39d4730-f8d7-4abe-990d-f6ba3e686c78 could not be found. Oct 17 03:11:48.524114 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-0f73789f-f601-4ab2-845c-1bf4d7f3dfdc tempest-VolumesSnapshotsTestJSON-1898637368 tempest-VolumesSnapshotsTestJSON-1898637368-project] Request method failure captured: Oct 17 03:11:48.524114 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: request: GET /compute/v2.1/os-volumes/f39d4730-f8d7-4abe-990d-f6ba3e686c78 HTTP/1.1 Oct 17 03:11:48.524114 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Accept: application/json Oct 17 03:11:48.524114 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Accept-Encoding: identity Oct 17 03:11:48.524114 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Connection: close Oct 17 03:11:48.524114 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Content-Length: 0 Oct 17 03:11:48.524114 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Content-Type: application/json Oct 17 03:11:48.524114 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Host: 10.222.0.27 Oct 17 03:11:48.524114 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Openstack-System-Scope: None Oct 17 03:11:48.524114 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: User-Agent: python-urllib3/1.26.12 Oct 17 03:11:48.524114 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Auth-Token: gAAAAABjTMfpfDihG65aQcpsSso6vn_C1g-QHbGtnBNga737Wu7ZbiaYwCZnWLiu0TCW9ykQGIfMILfetTqZAR-NvheAfexyv1SHcTqmXks7a1antYcnAZidCSvONS7yM5xJ1qxifHTjgDLzsjBkLSQEkNrYUF3ZD_r-w7uZKHDT4DuRYLpdnqg Oct 17 03:11:48.524114 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Domain-Id: None Oct 17 03:11:48.524114 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Domain-Name: None Oct 17 03:11:48.524114 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Identity-Status: Confirmed Oct 17 03:11:48.524114 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Is-Admin-Project: True Oct 17 03:11:48.524114 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Project-Domain-Id: default Oct 17 03:11:48.524114 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Project-Domain-Name: Default Oct 17 03:11:48.524114 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Project-Id: 2867761270a140818364c8e25f2df0e4 Oct 17 03:11:48.524114 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1898637368 Oct 17 03:11:48.524114 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Role: member,reader Oct 17 03:11:48.524114 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Roles: member,reader Oct 17 03:11:48.525692 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2867761270a140818364c8e25f2df0e4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2867761270a140818364c8e25f2df0e4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2867761270a140818364c8e25f2df0e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2867761270a140818364c8e25f2df0e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 17 03:11:48.525692 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1898637368 Oct 17 03:11:48.525692 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Tenant-Id: 2867761270a140818364c8e25f2df0e4 Oct 17 03:11:48.525692 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1898637368 Oct 17 03:11:48.525692 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-User: tempest-VolumesSnapshotsTestJSON-1898637368-project Oct 17 03:11:48.525692 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-User-Domain-Id: default Oct 17 03:11:48.525692 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-User-Domain-Name: Default Oct 17 03:11:48.525692 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-User-Id: 9de79389028d4ebfa448de34193f74f8 Oct 17 03:11:48.525692 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1898637368-project Oct 17 03:11:48.525692 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: method: Oct 17 03:11:48.525692 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: exception: Volume f39d4730-f8d7-4abe-990d-f6ba3e686c78 could not be found. Oct 17 03:11:48.525692 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: action_args: {'id': 'f39d4730-f8d7-4abe-990d-f6ba3e686c78'} Oct 17 03:11:48.525692 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 03:11:48.526457 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:11:48.526457 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 17 03:11:48.526457 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 17 03:11:48.526457 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 17 03:11:48.526457 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 17 03:11:48.526457 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 17 03:11:48.526457 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 17 03:11:48.526457 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 17 03:11:48.526457 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 17 03:11:48.526457 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 17 03:11:48.526457 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 17 03:11:48.526457 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 03:11:48.526457 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 03:11:48.526457 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 03:11:48.526457 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 03:11:48.526457 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f39d4730-f8d7-4abe-990d-f6ba3e686c78 could not be found. (HTTP 404) (Request-ID: req-5a371727-8331-4e34-b2fd-495a50ddff76) Oct 17 03:11:48.526457 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Oct 17 03:11:48.526457 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:11:48.526457 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Oct 17 03:11:48.527586 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:11:48.527586 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 17 03:11:48.527586 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 17 03:11:48.527586 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 17 03:11:48.527586 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 17 03:11:48.527586 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 17 03:11:48.527586 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 17 03:11:48.527586 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 17 03:11:48.527586 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 17 03:11:48.527586 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 17 03:11:48.527586 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 17 03:11:48.527586 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 17 03:11:48.527586 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 17 03:11:48.527586 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 17 03:11:48.527586 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 17 03:11:48.527586 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 17 03:11:48.527586 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 17 03:11:48.527586 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 17 03:11:48.527586 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 17 03:11:48.528779 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 03:11:48.528779 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 03:11:48.528779 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 03:11:48.528779 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 03:11:48.528779 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f39d4730-f8d7-4abe-990d-f6ba3e686c78 could not be found. Oct 17 03:11:48.528779 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Oct 17 03:11:48.528779 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:11:48.528779 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Oct 17 03:11:48.528779 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:11:48.528779 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:11:48.528779 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:11:48.528779 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 03:11:48.528779 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 03:11:48.528779 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 03:11:48.528779 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 03:11:48.528779 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 03:11:48.528779 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 03:11:48.528779 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 17 03:11:48.528779 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 03:11:48.529918 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f39d4730-f8d7-4abe-990d-f6ba3e686c78 could not be found. Oct 17 03:11:48.529918 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Oct 17 03:11:48.529918 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:11:48.529918 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Oct 17 03:11:48.529918 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:11:48.529918 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:11:48.529918 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:11:48.529918 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 03:11:48.529918 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 03:11:48.529918 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f39d4730-f8d7-4abe-990d-f6ba3e686c78 could not be found. Oct 17 03:11:48.529918 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Oct 17 03:11:48.529918 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-0f73789f-f601-4ab2-845c-1bf4d7f3dfdc tempest-VolumesSnapshotsTestJSON-1898637368 tempest-VolumesSnapshotsTestJSON-1898637368-project] Returning 404 to user: Volume f39d4730-f8d7-4abe-990d-f6ba3e686c78 could not be found. {{(pid=118887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 03:11:48.529918 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-0f73789f-f601-4ab2-845c-1bf4d7f3dfdc tempest-VolumesSnapshotsTestJSON-1898637368 tempest-VolumesSnapshotsTestJSON-1898637368-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/f39d4730-f8d7-4abe-990d-f6ba3e686c78" status: 404 len: 109 microversion: 2.1 time: 0.078440 Oct 17 03:11:48.529918 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 13/28] 10.222.0.27 () {58 vars in 1245 bytes} [Mon Oct 17 03:11:48 2022] GET /compute/v2.1/os-volumes/f39d4730-f8d7-4abe-990d-f6ba3e686c78 => generated 109 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 03:11:56.880708 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-b3862ac4-e4bb-47bf-9d32-869629ef0b9c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1158935982", "imageRef": "e6d41914-f1bc-4b72-9113-1a69b3d0d83b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:11:57.001832 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-e9693982-2532-4b24-bd38-b0ed07be84fd tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Action: 'create', calling method: .version_select at 0x7fc7026ab550>, body: {"keypair": {"name": "tempest-keypair-463363565", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCCQKuIUz0xaeLtcdcpR3vD79dgFjLIAikRROiuaN0tWfeqpfb/8GfQjHcsbJsmsD1vlDN8163tdcIqKIVrIa8zJE3p3ZxsXJaV8Dew4ZL6jV8CTOp75FEFYyXoIgNUjkw=="}} {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:11:57.100953 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.network.neutron [None req-b3862ac4-e4bb-47bf-9d32-869629ef0b9c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] validate_networks() for [('9271d0b1-69d9-42d2-822e-fbd76c069e42', None, None, None, None, None)] {{(pid=118886) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 03:11:57.130487 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.quota [None req-e9693982-2532-4b24-bd38-b0ed07be84fd tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Getting quotas for project e5bad80dc0d74119b2a9cd5c1935e8d5. Resources: {'key_pairs'} {{(pid=118887) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 03:11:57.150185 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.quota [None req-e9693982-2532-4b24-bd38-b0ed07be84fd tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Getting quotas for user ce25db99a7b14d0bbaca41fff80e3da9 and project e5bad80dc0d74119b2a9cd5c1935e8d5. Resources: {'key_pairs'} {{(pid=118887) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 03:11:57.303125 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-e9693982-2532-4b24-bd38-b0ed07be84fd tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.697907 Oct 17 03:11:57.308444 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 14/29] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 17 03:11:56 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:11:57.317597 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-1e8d5d08-3896-428f-8255-bea171c5ebe8 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-822436328", "imageRef": "e6d41914-f1bc-4b72-9113-1a69b3d0d83b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7be2416a-9e29-4953-b802-c76adc0aa669"}], "security_groups": [{"name": "tempest-securitygroup--1313608638"}], "key_name": "tempest-keypair-1868694485", "user_data": "}} {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:11:57.702713 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.network.neutron [None req-1e8d5d08-3896-428f-8255-bea171c5ebe8 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] validate_networks() for [('7be2416a-9e29-4953-b802-c76adc0aa669', None, None, None, None, None)] {{(pid=118887) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 03:11:58.008589 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG dbcounter [-] [118886] Writing DB stats nova_cell0:SELECT=4 {{(pid=118886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:11:59.831979 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.virt.hardware [None req-b3862ac4-e4bb-47bf-9d32-869629ef0b9c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Flavor limits 0:0:0 {{(pid=118886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 03:11:59.833347 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.virt.hardware [None req-b3862ac4-e4bb-47bf-9d32-869629ef0b9c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Image limits 0:0:0 {{(pid=118886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 03:11:59.833901 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.virt.hardware [None req-b3862ac4-e4bb-47bf-9d32-869629ef0b9c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Flavor pref 0:0:0 {{(pid=118886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 03:11:59.834411 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.virt.hardware [None req-b3862ac4-e4bb-47bf-9d32-869629ef0b9c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Image pref 0:0:0 {{(pid=118886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 03:11:59.834914 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.virt.hardware [None req-b3862ac4-e4bb-47bf-9d32-869629ef0b9c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 03:11:59.870449 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-b3862ac4-e4bb-47bf-9d32-869629ef0b9c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:11:59.872651 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-b3862ac4-e4bb-47bf-9d32-869629ef0b9c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:11:59.873756 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-b3862ac4-e4bb-47bf-9d32-869629ef0b9c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:11:59.878248 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-b3862ac4-e4bb-47bf-9d32-869629ef0b9c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:11:59.879083 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-b3862ac4-e4bb-47bf-9d32-869629ef0b9c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:11:59.880037 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-b3862ac4-e4bb-47bf-9d32-869629ef0b9c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:11:59.953886 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.quota [None req-b3862ac4-e4bb-47bf-9d32-869629ef0b9c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Getting quotas for project ee21a91b84794e80b208fe72b7f1e010. Resources: {'instances', 'cores', 'ram'} {{(pid=118886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 03:11:59.965367 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.quota [None req-b3862ac4-e4bb-47bf-9d32-869629ef0b9c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Getting quotas for user 9c1787a9ef7c44e28076aaa80c0152fd and project ee21a91b84794e80b208fe72b7f1e010. Resources: {'instances', 'cores', 'ram'} {{(pid=118886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 03:11:59.996957 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-b3862ac4-e4bb-47bf-9d32-869629ef0b9c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Going to run 1 instances... {{(pid=118886) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 03:12:00.006009 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-b3862ac4-e4bb-47bf-9d32-869629ef0b9c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: 90f2768b-8259-439c-af06-7eff342615ee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e6d41914-f1bc-4b72-9113-1a69b3d0d83b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 03:12:00.100486 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.virt.hardware [None req-1e8d5d08-3896-428f-8255-bea171c5ebe8 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Flavor limits 0:0:0 {{(pid=118887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 03:12:00.101304 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.virt.hardware [None req-1e8d5d08-3896-428f-8255-bea171c5ebe8 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Image limits 0:0:0 {{(pid=118887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 03:12:00.101902 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.virt.hardware [None req-1e8d5d08-3896-428f-8255-bea171c5ebe8 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Flavor pref 0:0:0 {{(pid=118887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 03:12:00.102320 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.virt.hardware [None req-1e8d5d08-3896-428f-8255-bea171c5ebe8 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Image pref 0:0:0 {{(pid=118887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 03:12:00.102719 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.virt.hardware [None req-1e8d5d08-3896-428f-8255-bea171c5ebe8 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 03:12:00.129783 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-1e8d5d08-3896-428f-8255-bea171c5ebe8 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:00.130257 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-1e8d5d08-3896-428f-8255-bea171c5ebe8 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:00.130708 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-1e8d5d08-3896-428f-8255-bea171c5ebe8 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:00.131473 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-1e8d5d08-3896-428f-8255-bea171c5ebe8 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:00.140135 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-1e8d5d08-3896-428f-8255-bea171c5ebe8 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:00.141629 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-1e8d5d08-3896-428f-8255-bea171c5ebe8 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:00.209721 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-b3862ac4-e4bb-47bf-9d32-869629ef0b9c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.722663 Oct 17 03:12:00.221996 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 16/30] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 03:11:56 2022] POST /compute/v2.1/servers => generated 383 bytes in 3735 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 03:12:00.274814 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.quota [None req-1e8d5d08-3896-428f-8255-bea171c5ebe8 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Getting quotas for project 36f63b28bb4f4654b53a01507b337d52. Resources: {'instances', 'cores', 'ram'} {{(pid=118887) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 03:12:00.292190 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.quota [None req-1e8d5d08-3896-428f-8255-bea171c5ebe8 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Getting quotas for user 37e6d36d529146299970874660e92e43 and project 36f63b28bb4f4654b53a01507b337d52. Resources: {'instances', 'cores', 'ram'} {{(pid=118887) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 03:12:00.350396 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-1e8d5d08-3896-428f-8255-bea171c5ebe8 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Going to run 1 instances... {{(pid=118887) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 03:12:00.361035 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-1e8d5d08-3896-428f-8255-bea171c5ebe8 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 603ee2bf-bedf-4688-ac0a-77a2a50f33d7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e6d41914-f1bc-4b72-9113-1a69b3d0d83b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118887) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 03:12:00.569310 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-1e8d5d08-3896-428f-8255-bea171c5ebe8 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 3.258645 Oct 17 03:12:00.590847 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 15/31] 10.222.0.27 () {62 vars in 1188 bytes} [Mon Oct 17 03:11:57 2022] POST /compute/v2.1/servers => generated 402 bytes in 3280 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 17 03:12:01.094300 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-76e38e17-a9e7-49ce-96ea-9c9d80359ccb tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Action: 'create', calling method: .version_select at 0x7fc7024dc670>, body: {"keypair": {"name": "tempest-keypair-1429465092", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEfY+2rnDrqpRTwQdLK9cBGH3uqsmQBkWJdR5r9Y47qMi9cjfntg+bZn7vReZdjAuJqE7+NCr3TTBA1bHLhzP3CRY1CpO/ZLLvkEu99oBt7PqZvs7nXmDTJlyjw3nfXjww=="}} {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:12:01.136157 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.quota [None req-76e38e17-a9e7-49ce-96ea-9c9d80359ccb tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Getting quotas for project 618cf0b3507845909bb27c13460d1d6c. Resources: {'key_pairs'} {{(pid=118886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 03:12:01.142549 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.quota [None req-76e38e17-a9e7-49ce-96ea-9c9d80359ccb tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Getting quotas for user 1c786544e8fb4e8e8c3a4990a0f36725 and project 618cf0b3507845909bb27c13460d1d6c. Resources: {'key_pairs'} {{(pid=118886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 03:12:01.182731 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-76e38e17-a9e7-49ce-96ea-9c9d80359ccb tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.958918 Oct 17 03:12:01.190451 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 17/32] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 17 03:12:00 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:12:01.190451 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-8a200cec-d01e-4ed2-bd7a-7dc09da33ca8 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:12:01.190451 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-8a200cec-d01e-4ed2-bd7a-7dc09da33ca8 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: 90f2768b-8259-439c-af06-7eff342615ee] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:12:01.428284 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-8a200cec-d01e-4ed2-bd7a-7dc09da33ca8 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1787a9ef7c44e28076aaa80c0152fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee21a91b84794e80b208fe72b7f1e010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:01.476584 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-8a200cec-d01e-4ed2-bd7a-7dc09da33ca8 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "GET /compute/v2.1/servers/90f2768b-8259-439c-af06-7eff342615ee" status: 200 len: 1222 microversion: 2.1 time: 0.287683 Oct 17 03:12:01.482989 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 18/33] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:12:01 2022] GET /compute/v2.1/servers/90f2768b-8259-439c-af06-7eff342615ee => generated 1222 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:12:01.493470 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-5b6b188f-7feb-42c5-9a06-ad9410337250 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1210205779", "imageRef": "e6d41914-f1bc-4b72-9113-1a69b3d0d83b", "flavorRef": "452", "networks": [{"uuid": "e16dd6d1-a57f-4fbc-a68b-692ca1280274"}]}} {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:12:01.510175 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-bbf906ee-2690-4dc4-9334-8a324a83010c tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:12:01.511127 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-bbf906ee-2690-4dc4-9334-8a324a83010c tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 603ee2bf-bedf-4688-ac0a-77a2a50f33d7] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:12:01.675747 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.network.neutron [None req-5b6b188f-7feb-42c5-9a06-ad9410337250 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] validate_networks() for [('e16dd6d1-a57f-4fbc-a68b-692ca1280274', None, None, None, None, None)] {{(pid=118887) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 03:12:01.903910 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-bbf906ee-2690-4dc4-9334-8a324a83010c tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:01.915912 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-bbf906ee-2690-4dc4-9334-8a324a83010c tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:01.920620 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-bbf906ee-2690-4dc4-9334-8a324a83010c tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:01.925814 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-bbf906ee-2690-4dc4-9334-8a324a83010c tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7" status: 200 len: 1281 microversion: 2.20 time: 0.441689 Oct 17 03:12:01.932944 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 19/34] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 03:12:01 2022] GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7 => generated 1281 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:12:02.273783 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-ef2ff69d-4064-4098-b2f2-e0b50f520c67 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1429726272", "imageRef": "e6d41914-f1bc-4b72-9113-1a69b3d0d83b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:12:02.400976 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.network.neutron [None req-ef2ff69d-4064-4098-b2f2-e0b50f520c67 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] validate_networks() for [('9271d0b1-69d9-42d2-822e-fbd76c069e42', None, None, None, None, None)] {{(pid=118886) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 03:12:02.838852 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.virt.hardware [None req-5b6b188f-7feb-42c5-9a06-ad9410337250 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Flavor limits 0:0:0 {{(pid=118887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 03:12:02.840958 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.virt.hardware [None req-5b6b188f-7feb-42c5-9a06-ad9410337250 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Image limits 0:0:0 {{(pid=118887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 03:12:02.841811 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.virt.hardware [None req-5b6b188f-7feb-42c5-9a06-ad9410337250 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Flavor pref 0:0:0 {{(pid=118887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 03:12:02.842535 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.virt.hardware [None req-5b6b188f-7feb-42c5-9a06-ad9410337250 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Image pref 0:0:0 {{(pid=118887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 03:12:02.844084 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.virt.hardware [None req-5b6b188f-7feb-42c5-9a06-ad9410337250 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 03:12:02.884130 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-5b6b188f-7feb-42c5-9a06-ad9410337250 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:02.884796 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-5b6b188f-7feb-42c5-9a06-ad9410337250 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:02.885314 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-5b6b188f-7feb-42c5-9a06-ad9410337250 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:02.886214 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-5b6b188f-7feb-42c5-9a06-ad9410337250 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:02.886682 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-5b6b188f-7feb-42c5-9a06-ad9410337250 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:02.887216 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-5b6b188f-7feb-42c5-9a06-ad9410337250 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:02.953194 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.quota [None req-5b6b188f-7feb-42c5-9a06-ad9410337250 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Getting quotas for project d03f03d21e9e42fb91606306241a3fb7. Resources: {'instances', 'cores', 'ram'} {{(pid=118887) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 03:12:02.961588 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.quota [None req-5b6b188f-7feb-42c5-9a06-ad9410337250 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Getting quotas for user 4443729a5a5341b6ad64f6fa131a5a54 and project d03f03d21e9e42fb91606306241a3fb7. Resources: {'instances', 'cores', 'ram'} {{(pid=118887) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 03:12:03.000438 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-5b6b188f-7feb-42c5-9a06-ad9410337250 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Going to run 1 instances... {{(pid=118887) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 03:12:03.005117 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-5b6b188f-7feb-42c5-9a06-ad9410337250 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] [instance: f4241d22-757d-4baa-bee5-476e3fab96a8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e6d41914-f1bc-4b72-9113-1a69b3d0d83b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118887) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 03:12:03.085821 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-5b6b188f-7feb-42c5-9a06-ad9410337250 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.477841 Oct 17 03:12:03.086820 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 16/35] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 03:12:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 2497 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 03:12:03.124919 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-4b9e87b0-63ab-449f-80dd-143e639fb74e tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:12:03.127769 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-4b9e87b0-63ab-449f-80dd-143e639fb74e tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 603ee2bf-bedf-4688-ac0a-77a2a50f33d7] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:12:03.824637 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-4b9e87b0-63ab-449f-80dd-143e639fb74e tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:03.863994 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-4b9e87b0-63ab-449f-80dd-143e639fb74e tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:03.869447 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-4b9e87b0-63ab-449f-80dd-143e639fb74e tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:03.870709 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-4b9e87b0-63ab-449f-80dd-143e639fb74e tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7" status: 200 len: 1281 microversion: 2.20 time: 0.782914 Oct 17 03:12:03.922605 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 17/36] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 03:12:03 2022] GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7 => generated 1281 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:12:03.973743 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-faa3c3f5-4696-497e-88e4-b1af198b2497 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:12:03.974452 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-faa3c3f5-4696-497e-88e4-b1af198b2497 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] [instance: f4241d22-757d-4baa-bee5-476e3fab96a8] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:12:04.237456 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-faa3c3f5-4696-497e-88e4-b1af198b2497 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4443729a5a5341b6ad64f6fa131a5a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd03f03d21e9e42fb91606306241a3fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:04.252516 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-faa3c3f5-4696-497e-88e4-b1af198b2497 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] 10.222.0.27 "GET /compute/v2.1/servers/f4241d22-757d-4baa-bee5-476e3fab96a8" status: 200 len: 1215 microversion: 2.1 time: 0.322918 Oct 17 03:12:04.272294 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 18/37] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:12:03 2022] GET /compute/v2.1/servers/f4241d22-757d-4baa-bee5-476e3fab96a8 => generated 1215 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:12:04.622836 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-99ac5c89-b60f-4df2-85b4-c78ad82fe9e5 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1387660166", "imageRef": "e6d41914-f1bc-4b72-9113-1a69b3d0d83b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b76b6d47-52a1-4c1b-a84c-d9fcfdadba83"}], "security_groups": [{"name": "tempest-securitygroup--2111688051"}], "key_name": "tempest-keypair-463363565", "user_data": "}} {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:12:04.878104 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.network.neutron [None req-99ac5c89-b60f-4df2-85b4-c78ad82fe9e5 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] validate_networks() for [('b76b6d47-52a1-4c1b-a84c-d9fcfdadba83', None, None, None, None, None)] {{(pid=118887) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 03:12:05.221773 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.virt.hardware [None req-ef2ff69d-4064-4098-b2f2-e0b50f520c67 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Flavor limits 0:0:0 {{(pid=118886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 03:12:05.223078 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.virt.hardware [None req-ef2ff69d-4064-4098-b2f2-e0b50f520c67 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Image limits 0:0:0 {{(pid=118886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 03:12:05.223761 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.virt.hardware [None req-ef2ff69d-4064-4098-b2f2-e0b50f520c67 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Flavor pref 0:0:0 {{(pid=118886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 03:12:05.224377 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.virt.hardware [None req-ef2ff69d-4064-4098-b2f2-e0b50f520c67 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Image pref 0:0:0 {{(pid=118886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 03:12:05.225083 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.virt.hardware [None req-ef2ff69d-4064-4098-b2f2-e0b50f520c67 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 03:12:05.236308 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-ef2ff69d-4064-4098-b2f2-e0b50f520c67 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:05.237588 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-ef2ff69d-4064-4098-b2f2-e0b50f520c67 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:05.238363 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-ef2ff69d-4064-4098-b2f2-e0b50f520c67 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:05.239931 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-ef2ff69d-4064-4098-b2f2-e0b50f520c67 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:05.240849 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-ef2ff69d-4064-4098-b2f2-e0b50f520c67 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:05.242077 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-ef2ff69d-4064-4098-b2f2-e0b50f520c67 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:05.318918 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.quota [None req-ef2ff69d-4064-4098-b2f2-e0b50f520c67 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Getting quotas for project ee21a91b84794e80b208fe72b7f1e010. Resources: {'instances', 'cores', 'ram'} {{(pid=118886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 03:12:05.336394 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.quota [None req-ef2ff69d-4064-4098-b2f2-e0b50f520c67 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Getting quotas for user 9c1787a9ef7c44e28076aaa80c0152fd and project ee21a91b84794e80b208fe72b7f1e010. Resources: {'instances', 'cores', 'ram'} {{(pid=118886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 03:12:05.372777 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-ef2ff69d-4064-4098-b2f2-e0b50f520c67 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Going to run 1 instances... {{(pid=118886) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 03:12:05.382983 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-ef2ff69d-4064-4098-b2f2-e0b50f520c67 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: f430d340-f7ff-4805-bd00-69eeaf33250d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e6d41914-f1bc-4b72-9113-1a69b3d0d83b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 03:12:05.513898 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-ef2ff69d-4064-4098-b2f2-e0b50f520c67 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.245168 Oct 17 03:12:05.516071 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 20/38] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 03:12:02 2022] POST /compute/v2.1/servers => generated 383 bytes in 3248 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 17 03:12:05.523701 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-2a7ec5f7-90fa-4c98-8dd4-7771ac8a3731 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:12:05.524649 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-2a7ec5f7-90fa-4c98-8dd4-7771ac8a3731 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 603ee2bf-bedf-4688-ac0a-77a2a50f33d7] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:12:05.533083 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-2a7ec5f7-90fa-4c98-8dd4-7771ac8a3731 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:05.534058 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-2a7ec5f7-90fa-4c98-8dd4-7771ac8a3731 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:05.534701 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-2a7ec5f7-90fa-4c98-8dd4-7771ac8a3731 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:05.535699 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-2a7ec5f7-90fa-4c98-8dd4-7771ac8a3731 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:05.536440 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-2a7ec5f7-90fa-4c98-8dd4-7771ac8a3731 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:05.537060 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-2a7ec5f7-90fa-4c98-8dd4-7771ac8a3731 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:06.019528 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-2a7ec5f7-90fa-4c98-8dd4-7771ac8a3731 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:06.058590 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-2a7ec5f7-90fa-4c98-8dd4-7771ac8a3731 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:06.060784 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-2a7ec5f7-90fa-4c98-8dd4-7771ac8a3731 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:06.062140 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-2a7ec5f7-90fa-4c98-8dd4-7771ac8a3731 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7" status: 200 len: 1333 microversion: 2.20 time: 0.543797 Oct 17 03:12:06.077611 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 21/39] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 03:12:05 2022] GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7 => generated 1333 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:12:06.084434 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.virt.hardware [None req-99ac5c89-b60f-4df2-85b4-c78ad82fe9e5 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Flavor limits 0:0:0 {{(pid=118887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 03:12:06.085831 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.virt.hardware [None req-99ac5c89-b60f-4df2-85b4-c78ad82fe9e5 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Image limits 0:0:0 {{(pid=118887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 03:12:06.086475 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.virt.hardware [None req-99ac5c89-b60f-4df2-85b4-c78ad82fe9e5 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Flavor pref 0:0:0 {{(pid=118887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 03:12:06.087080 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.virt.hardware [None req-99ac5c89-b60f-4df2-85b4-c78ad82fe9e5 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Image pref 0:0:0 {{(pid=118887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 03:12:06.088346 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.virt.hardware [None req-99ac5c89-b60f-4df2-85b4-c78ad82fe9e5 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 03:12:06.091877 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-5e75b185-0740-4a95-9bd8-a01cf5514670 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:12:06.092844 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-5e75b185-0740-4a95-9bd8-a01cf5514670 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] [instance: f4241d22-757d-4baa-bee5-476e3fab96a8] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:12:06.101577 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-5e75b185-0740-4a95-9bd8-a01cf5514670 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:06.102195 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-99ac5c89-b60f-4df2-85b4-c78ad82fe9e5 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:06.102470 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-5e75b185-0740-4a95-9bd8-a01cf5514670 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:06.102692 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-99ac5c89-b60f-4df2-85b4-c78ad82fe9e5 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:06.103268 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-5e75b185-0740-4a95-9bd8-a01cf5514670 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:06.104300 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-5e75b185-0740-4a95-9bd8-a01cf5514670 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:06.104881 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-5e75b185-0740-4a95-9bd8-a01cf5514670 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:06.105469 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-5e75b185-0740-4a95-9bd8-a01cf5514670 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:06.105884 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-99ac5c89-b60f-4df2-85b4-c78ad82fe9e5 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:06.107243 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-99ac5c89-b60f-4df2-85b4-c78ad82fe9e5 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:06.107727 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-99ac5c89-b60f-4df2-85b4-c78ad82fe9e5 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:06.108173 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-99ac5c89-b60f-4df2-85b4-c78ad82fe9e5 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:06.204327 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.quota [None req-99ac5c89-b60f-4df2-85b4-c78ad82fe9e5 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Getting quotas for project e5bad80dc0d74119b2a9cd5c1935e8d5. Resources: {'instances', 'cores', 'ram'} {{(pid=118887) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 03:12:06.221271 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.quota [None req-99ac5c89-b60f-4df2-85b4-c78ad82fe9e5 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Getting quotas for user ce25db99a7b14d0bbaca41fff80e3da9 and project e5bad80dc0d74119b2a9cd5c1935e8d5. Resources: {'instances', 'cores', 'ram'} {{(pid=118887) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 03:12:06.237626 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-99ac5c89-b60f-4df2-85b4-c78ad82fe9e5 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Going to run 1 instances... {{(pid=118887) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 03:12:06.240352 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-99ac5c89-b60f-4df2-85b4-c78ad82fe9e5 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] [instance: 7b220b35-d9ac-48e4-b898-3d4f6c7be835] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e6d41914-f1bc-4b72-9113-1a69b3d0d83b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118887) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 03:12:06.375918 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-5e75b185-0740-4a95-9bd8-a01cf5514670 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4443729a5a5341b6ad64f6fa131a5a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd03f03d21e9e42fb91606306241a3fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:06.385147 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-99ac5c89-b60f-4df2-85b4-c78ad82fe9e5 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.764815 Oct 17 03:12:06.397335 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 19/40] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 03:12:04 2022] POST /compute/v2.1/servers => generated 402 bytes in 1780 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 03:12:06.403064 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-5e75b185-0740-4a95-9bd8-a01cf5514670 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] 10.222.0.27 "GET /compute/v2.1/servers/f4241d22-757d-4baa-bee5-476e3fab96a8" status: 200 len: 1211 microversion: 2.1 time: 0.300669 Oct 17 03:12:06.404154 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 22/41] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:12:06 2022] GET /compute/v2.1/servers/f4241d22-757d-4baa-bee5-476e3fab96a8 => generated 1211 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:12:06.431460 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-374ee588-2c8f-43da-aa1d-0efe89a67b59 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:12:06.434182 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-374ee588-2c8f-43da-aa1d-0efe89a67b59 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] [instance: 7b220b35-d9ac-48e4-b898-3d4f6c7be835] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:12:06.439191 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-eacbd548-53af-4448-a688-d79a7243ad34 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:12:06.441992 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-eacbd548-53af-4448-a688-d79a7243ad34 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: f430d340-f7ff-4805-bd00-69eeaf33250d] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:12:06.808695 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-eacbd548-53af-4448-a688-d79a7243ad34 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1787a9ef7c44e28076aaa80c0152fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee21a91b84794e80b208fe72b7f1e010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:06.815949 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-eacbd548-53af-4448-a688-d79a7243ad34 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "GET /compute/v2.1/servers/f430d340-f7ff-4805-bd00-69eeaf33250d" status: 200 len: 1222 microversion: 2.1 time: 0.415627 Oct 17 03:12:06.820391 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 20/42] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:12:06 2022] GET /compute/v2.1/servers/f430d340-f7ff-4805-bd00-69eeaf33250d => generated 1222 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:12:06.952064 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-374ee588-2c8f-43da-aa1d-0efe89a67b59 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce25db99a7b14d0bbaca41fff80e3da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5bad80dc0d74119b2a9cd5c1935e8d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:06.961368 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-374ee588-2c8f-43da-aa1d-0efe89a67b59 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] 10.222.0.27 "GET /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835" status: 200 len: 1237 microversion: 2.1 time: 0.552376 Oct 17 03:12:06.961944 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 23/43] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:12:06 2022] GET /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835 => generated 1237 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:12:07.094826 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-e1221b96-7644-4375-b3f8-1d438a1cd86f tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:12:07.095620 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-e1221b96-7644-4375-b3f8-1d438a1cd86f tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 603ee2bf-bedf-4688-ac0a-77a2a50f33d7] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:12:07.106324 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-e1221b96-7644-4375-b3f8-1d438a1cd86f tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:07.107009 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-e1221b96-7644-4375-b3f8-1d438a1cd86f tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:07.107009 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-e1221b96-7644-4375-b3f8-1d438a1cd86f tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:07.107574 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-e1221b96-7644-4375-b3f8-1d438a1cd86f tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:07.108032 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-e1221b96-7644-4375-b3f8-1d438a1cd86f tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:07.109489 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-e1221b96-7644-4375-b3f8-1d438a1cd86f tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:07.432240 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-e73b646c-336a-4589-a90e-5d211cdd6177 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:12:07.432867 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-e73b646c-336a-4589-a90e-5d211cdd6177 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] [instance: f4241d22-757d-4baa-bee5-476e3fab96a8] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:12:07.449125 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-e73b646c-336a-4589-a90e-5d211cdd6177 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:07.449773 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-e73b646c-336a-4589-a90e-5d211cdd6177 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:07.450238 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-e73b646c-336a-4589-a90e-5d211cdd6177 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:07.451001 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-e73b646c-336a-4589-a90e-5d211cdd6177 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:07.451468 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-e73b646c-336a-4589-a90e-5d211cdd6177 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:07.451901 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-e73b646c-336a-4589-a90e-5d211cdd6177 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:07.783757 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-e73b646c-336a-4589-a90e-5d211cdd6177 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4443729a5a5341b6ad64f6fa131a5a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd03f03d21e9e42fb91606306241a3fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:07.829164 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-e73b646c-336a-4589-a90e-5d211cdd6177 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] 10.222.0.27 "GET /compute/v2.1/servers/f4241d22-757d-4baa-bee5-476e3fab96a8" status: 200 len: 1267 microversion: 2.1 time: 0.401172 Oct 17 03:12:07.832249 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 24/44] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:12:07 2022] GET /compute/v2.1/servers/f4241d22-757d-4baa-bee5-476e3fab96a8 => generated 1267 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:12:07.858032 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-7bbe4e5e-bbb7-4601-a92e-74d7a5ade5ef tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:12:07.860186 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-7bbe4e5e-bbb7-4601-a92e-74d7a5ade5ef tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: f430d340-f7ff-4805-bd00-69eeaf33250d] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:12:07.890550 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-7bbe4e5e-bbb7-4601-a92e-74d7a5ade5ef tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:07.895668 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-7bbe4e5e-bbb7-4601-a92e-74d7a5ade5ef tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:07.898195 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-7bbe4e5e-bbb7-4601-a92e-74d7a5ade5ef tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:07.902086 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-7bbe4e5e-bbb7-4601-a92e-74d7a5ade5ef tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:07.908450 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-7bbe4e5e-bbb7-4601-a92e-74d7a5ade5ef tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:07.910354 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-7bbe4e5e-bbb7-4601-a92e-74d7a5ade5ef tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:07.948010 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-e1221b96-7644-4375-b3f8-1d438a1cd86f tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:07.984874 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-e1221b96-7644-4375-b3f8-1d438a1cd86f tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:07.986982 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-e1221b96-7644-4375-b3f8-1d438a1cd86f tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:07.996589 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-e1221b96-7644-4375-b3f8-1d438a1cd86f tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7" status: 200 len: 1339 microversion: 2.20 time: 0.906024 Oct 17 03:12:08.000344 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 21/45] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 03:12:07 2022] GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7 => generated 1339 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:12:08.039405 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-c8549277-6db7-4510-b341-c48c39e2f427 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:12:08.045302 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-c8549277-6db7-4510-b341-c48c39e2f427 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] [instance: 7b220b35-d9ac-48e4-b898-3d4f6c7be835] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:12:08.067443 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-c8549277-6db7-4510-b341-c48c39e2f427 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:08.068656 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-c8549277-6db7-4510-b341-c48c39e2f427 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:08.071420 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-c8549277-6db7-4510-b341-c48c39e2f427 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:08.075031 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-c8549277-6db7-4510-b341-c48c39e2f427 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:08.076221 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-c8549277-6db7-4510-b341-c48c39e2f427 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:08.077544 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-c8549277-6db7-4510-b341-c48c39e2f427 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:08.327204 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-7bbe4e5e-bbb7-4601-a92e-74d7a5ade5ef tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1787a9ef7c44e28076aaa80c0152fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee21a91b84794e80b208fe72b7f1e010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:08.342411 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-7bbe4e5e-bbb7-4601-a92e-74d7a5ade5ef tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "GET /compute/v2.1/servers/f430d340-f7ff-4805-bd00-69eeaf33250d" status: 200 len: 1274 microversion: 2.1 time: 0.492984 Oct 17 03:12:08.349903 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 25/46] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:12:07 2022] GET /compute/v2.1/servers/f430d340-f7ff-4805-bd00-69eeaf33250d => generated 1274 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:12:08.472254 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-c8549277-6db7-4510-b341-c48c39e2f427 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce25db99a7b14d0bbaca41fff80e3da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5bad80dc0d74119b2a9cd5c1935e8d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:08.487496 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-c8549277-6db7-4510-b341-c48c39e2f427 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] 10.222.0.27 "GET /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835" status: 200 len: 1233 microversion: 2.1 time: 0.474999 Oct 17 03:12:08.493163 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 22/47] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:12:08 2022] GET /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835 => generated 1233 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:12:08.857216 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-23c70e59-abd8-477a-8ffa-806af71f9401 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:12:08.858435 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-23c70e59-abd8-477a-8ffa-806af71f9401 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] [instance: f4241d22-757d-4baa-bee5-476e3fab96a8] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:12:08.886345 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-23c70e59-abd8-477a-8ffa-806af71f9401 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:08.887002 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-23c70e59-abd8-477a-8ffa-806af71f9401 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:08.903396 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-23c70e59-abd8-477a-8ffa-806af71f9401 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:08.904203 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-23c70e59-abd8-477a-8ffa-806af71f9401 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:08.904810 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-23c70e59-abd8-477a-8ffa-806af71f9401 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:08.905359 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-23c70e59-abd8-477a-8ffa-806af71f9401 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:09.028564 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-6377aac3-ee4a-4b01-a843-8b2dcf15670b tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:12:09.029494 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-6377aac3-ee4a-4b01-a843-8b2dcf15670b tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 603ee2bf-bedf-4688-ac0a-77a2a50f33d7] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:12:09.046849 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-6377aac3-ee4a-4b01-a843-8b2dcf15670b tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:09.050661 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-6377aac3-ee4a-4b01-a843-8b2dcf15670b tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:09.052654 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-6377aac3-ee4a-4b01-a843-8b2dcf15670b tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:09.056761 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-6377aac3-ee4a-4b01-a843-8b2dcf15670b tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:09.058619 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-6377aac3-ee4a-4b01-a843-8b2dcf15670b tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:09.059318 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-6377aac3-ee4a-4b01-a843-8b2dcf15670b tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:09.634312 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-6377aac3-ee4a-4b01-a843-8b2dcf15670b tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:09.652768 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-6377aac3-ee4a-4b01-a843-8b2dcf15670b tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:09.654407 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-6377aac3-ee4a-4b01-a843-8b2dcf15670b tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:09.657951 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-6377aac3-ee4a-4b01-a843-8b2dcf15670b tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7" status: 200 len: 1339 microversion: 2.20 time: 0.633952 Oct 17 03:12:09.661700 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 23/48] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 03:12:09 2022] GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7 => generated 1339 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:12:09.673206 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-d87210a2-204d-4733-99cc-c984a8a038b5 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-836862108", "imageRef": "e6d41914-f1bc-4b72-9113-1a69b3d0d83b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5bef7eaf-4926-430d-bb2f-ad10a16554bf"}], "security_groups": [{"name": "tempest-securitygroup--1088647808"}], "key_name": "tempest-keypair-1429465092", "user_data": "}} {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:12:10.397102 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-23c70e59-abd8-477a-8ffa-806af71f9401 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4443729a5a5341b6ad64f6fa131a5a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd03f03d21e9e42fb91606306241a3fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:10.407110 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-23c70e59-abd8-477a-8ffa-806af71f9401 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] 10.222.0.27 "GET /compute/v2.1/servers/f4241d22-757d-4baa-bee5-476e3fab96a8" status: 200 len: 1273 microversion: 2.1 time: 1.554051 Oct 17 03:12:10.416188 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 26/49] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:12:08 2022] GET /compute/v2.1/servers/f4241d22-757d-4baa-bee5-476e3fab96a8 => generated 1273 bytes in 1564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:12:10.442387 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-3f3f9734-234e-4d5b-9f6a-80ffa626b4ce tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:12:10.477950 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-3f3f9734-234e-4d5b-9f6a-80ffa626b4ce tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: f430d340-f7ff-4805-bd00-69eeaf33250d] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:12:10.517213 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-3f3f9734-234e-4d5b-9f6a-80ffa626b4ce tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:10.517721 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-3f3f9734-234e-4d5b-9f6a-80ffa626b4ce tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:10.518167 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-3f3f9734-234e-4d5b-9f6a-80ffa626b4ce tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:10.530122 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-3f3f9734-234e-4d5b-9f6a-80ffa626b4ce tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:10.532251 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-3f3f9734-234e-4d5b-9f6a-80ffa626b4ce tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:10.536510 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-3f3f9734-234e-4d5b-9f6a-80ffa626b4ce tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:10.965299 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-3f3f9734-234e-4d5b-9f6a-80ffa626b4ce tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1787a9ef7c44e28076aaa80c0152fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee21a91b84794e80b208fe72b7f1e010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:10.995580 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-3f3f9734-234e-4d5b-9f6a-80ffa626b4ce tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "GET /compute/v2.1/servers/f430d340-f7ff-4805-bd00-69eeaf33250d" status: 200 len: 1280 microversion: 2.1 time: 0.578083 Oct 17 03:12:11.005988 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 27/50] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:12:10 2022] GET /compute/v2.1/servers/f430d340-f7ff-4805-bd00-69eeaf33250d => generated 1280 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:12:11.045420 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-c1d7630d-0f79-4ec1-b4bc-d23fb84d81d5 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:12:11.048435 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-c1d7630d-0f79-4ec1-b4bc-d23fb84d81d5 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] [instance: 7b220b35-d9ac-48e4-b898-3d4f6c7be835] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:12:11.076245 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-c1d7630d-0f79-4ec1-b4bc-d23fb84d81d5 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:11.076814 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-c1d7630d-0f79-4ec1-b4bc-d23fb84d81d5 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:11.079659 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-c1d7630d-0f79-4ec1-b4bc-d23fb84d81d5 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:11.082157 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-c1d7630d-0f79-4ec1-b4bc-d23fb84d81d5 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:11.082577 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-c1d7630d-0f79-4ec1-b4bc-d23fb84d81d5 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:11.084226 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-c1d7630d-0f79-4ec1-b4bc-d23fb84d81d5 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:11.291497 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.network.neutron [None req-d87210a2-204d-4733-99cc-c984a8a038b5 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] validate_networks() for [('5bef7eaf-4926-430d-bb2f-ad10a16554bf', None, None, None, None, None)] {{(pid=118887) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 03:12:11.340586 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-c1d7630d-0f79-4ec1-b4bc-d23fb84d81d5 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce25db99a7b14d0bbaca41fff80e3da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5bad80dc0d74119b2a9cd5c1935e8d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:11.351582 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-c1d7630d-0f79-4ec1-b4bc-d23fb84d81d5 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] 10.222.0.27 "GET /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835" status: 200 len: 1295 microversion: 2.1 time: 0.340108 Oct 17 03:12:11.354442 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 28/51] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:12:11 2022] GET /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835 => generated 1295 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:12:11.363180 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-85dcb109-81d7-4064-b526-3feba9b5c5cd tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:12:11.371602 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-85dcb109-81d7-4064-b526-3feba9b5c5cd tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 603ee2bf-bedf-4688-ac0a-77a2a50f33d7] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:12:11.391886 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-85dcb109-81d7-4064-b526-3feba9b5c5cd tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:11.392400 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-85dcb109-81d7-4064-b526-3feba9b5c5cd tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:11.395669 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-85dcb109-81d7-4064-b526-3feba9b5c5cd tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:11.403875 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-85dcb109-81d7-4064-b526-3feba9b5c5cd tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:11.404462 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-85dcb109-81d7-4064-b526-3feba9b5c5cd tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:11.404860 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-85dcb109-81d7-4064-b526-3feba9b5c5cd tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:12.007886 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-85dcb109-81d7-4064-b526-3feba9b5c5cd tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:12.029716 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-85dcb109-81d7-4064-b526-3feba9b5c5cd tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:12.029716 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-85dcb109-81d7-4064-b526-3feba9b5c5cd tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:12.029716 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-85dcb109-81d7-4064-b526-3feba9b5c5cd tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7" status: 200 len: 1407 microversion: 2.20 time: 0.672904 Oct 17 03:12:12.042223 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 29/52] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 03:12:11 2022] GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7 => generated 1407 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:12:12.048274 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-b28d4f7d-533e-4bf8-880c-b2e9681ba29a tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:12:12.048888 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-b28d4f7d-533e-4bf8-880c-b2e9681ba29a tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] [instance: f4241d22-757d-4baa-bee5-476e3fab96a8] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:12:12.104677 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-b28d4f7d-533e-4bf8-880c-b2e9681ba29a tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:12.105179 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-b28d4f7d-533e-4bf8-880c-b2e9681ba29a tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:12.109839 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-b28d4f7d-533e-4bf8-880c-b2e9681ba29a tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:12.110677 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-b28d4f7d-533e-4bf8-880c-b2e9681ba29a tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:12.111222 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-b28d4f7d-533e-4bf8-880c-b2e9681ba29a tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:12.111661 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-b28d4f7d-533e-4bf8-880c-b2e9681ba29a tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:13.184793 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-b28d4f7d-533e-4bf8-880c-b2e9681ba29a tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4443729a5a5341b6ad64f6fa131a5a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd03f03d21e9e42fb91606306241a3fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:13.230996 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-b28d4f7d-533e-4bf8-880c-b2e9681ba29a tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] 10.222.0.27 "GET /compute/v2.1/servers/f4241d22-757d-4baa-bee5-476e3fab96a8" status: 200 len: 1315 microversion: 2.1 time: 1.182623 Oct 17 03:12:13.233544 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 30/53] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:12:12 2022] GET /compute/v2.1/servers/f4241d22-757d-4baa-bee5-476e3fab96a8 => generated 1315 bytes in 1191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:12:13.251789 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-49d78572-9975-45bf-9471-b8227c85ce7c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:12:13.255278 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-49d78572-9975-45bf-9471-b8227c85ce7c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: f430d340-f7ff-4805-bd00-69eeaf33250d] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:12:13.292927 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-49d78572-9975-45bf-9471-b8227c85ce7c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:13.294234 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-49d78572-9975-45bf-9471-b8227c85ce7c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:13.298376 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-49d78572-9975-45bf-9471-b8227c85ce7c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:13.300036 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-49d78572-9975-45bf-9471-b8227c85ce7c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:13.301936 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-49d78572-9975-45bf-9471-b8227c85ce7c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:13.305997 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-49d78572-9975-45bf-9471-b8227c85ce7c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:13.803083 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-49d78572-9975-45bf-9471-b8227c85ce7c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1787a9ef7c44e28076aaa80c0152fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee21a91b84794e80b208fe72b7f1e010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:13.820989 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-49d78572-9975-45bf-9471-b8227c85ce7c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "GET /compute/v2.1/servers/f430d340-f7ff-4805-bd00-69eeaf33250d" status: 200 len: 1280 microversion: 2.1 time: 0.584770 Oct 17 03:12:13.827878 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 31/54] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:12:13 2022] GET /compute/v2.1/servers/f430d340-f7ff-4805-bd00-69eeaf33250d => generated 1280 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:12:13.846395 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-273d16ca-3066-4abf-8907-9e0e61046358 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:12:13.848822 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-273d16ca-3066-4abf-8907-9e0e61046358 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] [instance: 7b220b35-d9ac-48e4-b898-3d4f6c7be835] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:12:13.871313 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-273d16ca-3066-4abf-8907-9e0e61046358 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:13.873794 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-273d16ca-3066-4abf-8907-9e0e61046358 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:13.876429 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-273d16ca-3066-4abf-8907-9e0e61046358 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:13.877172 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-273d16ca-3066-4abf-8907-9e0e61046358 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:13.877641 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-273d16ca-3066-4abf-8907-9e0e61046358 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:13.878164 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-273d16ca-3066-4abf-8907-9e0e61046358 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:14.875480 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-273d16ca-3066-4abf-8907-9e0e61046358 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce25db99a7b14d0bbaca41fff80e3da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5bad80dc0d74119b2a9cd5c1935e8d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:14.897399 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-273d16ca-3066-4abf-8907-9e0e61046358 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] 10.222.0.27 "GET /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835" status: 200 len: 1363 microversion: 2.1 time: 1.068161 Oct 17 03:12:14.901513 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 32/55] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:12:13 2022] GET /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835 => generated 1363 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:12:14.939711 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-065bfe2c-95b1-46c0-b086-0ae456865bd8 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:12:14.943946 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-065bfe2c-95b1-46c0-b086-0ae456865bd8 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 603ee2bf-bedf-4688-ac0a-77a2a50f33d7] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:12:14.969640 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-065bfe2c-95b1-46c0-b086-0ae456865bd8 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:14.973839 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-065bfe2c-95b1-46c0-b086-0ae456865bd8 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:14.977218 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-065bfe2c-95b1-46c0-b086-0ae456865bd8 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:14.980683 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-065bfe2c-95b1-46c0-b086-0ae456865bd8 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:14.985397 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-065bfe2c-95b1-46c0-b086-0ae456865bd8 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:14.986041 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-065bfe2c-95b1-46c0-b086-0ae456865bd8 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:15.303259 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG dbcounter [-] [118886] Writing DB stats nova_cell0:SELECT=4 {{(pid=118886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:12:15.747281 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-065bfe2c-95b1-46c0-b086-0ae456865bd8 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:15.763643 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-065bfe2c-95b1-46c0-b086-0ae456865bd8 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:15.767441 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-065bfe2c-95b1-46c0-b086-0ae456865bd8 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:15.771311 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-065bfe2c-95b1-46c0-b086-0ae456865bd8 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7" status: 200 len: 1407 microversion: 2.20 time: 0.868504 Oct 17 03:12:15.775563 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 33/56] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 03:12:14 2022] GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7 => generated 1407 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:12:15.782320 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-2b14b2e9-a33b-4fed-afe6-94c5593b5b79 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:12:15.788461 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-2b14b2e9-a33b-4fed-afe6-94c5593b5b79 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] [instance: f4241d22-757d-4baa-bee5-476e3fab96a8] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:12:15.813627 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-2b14b2e9-a33b-4fed-afe6-94c5593b5b79 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:15.816643 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-2b14b2e9-a33b-4fed-afe6-94c5593b5b79 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:15.817268 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-2b14b2e9-a33b-4fed-afe6-94c5593b5b79 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:15.819779 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-2b14b2e9-a33b-4fed-afe6-94c5593b5b79 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:15.820681 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-2b14b2e9-a33b-4fed-afe6-94c5593b5b79 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:15.831188 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-2b14b2e9-a33b-4fed-afe6-94c5593b5b79 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:16.124032 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG dbcounter [-] [118887] Writing DB stats nova_cell0:SELECT=6 {{(pid=118887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:12:16.489138 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.virt.hardware [None req-d87210a2-204d-4733-99cc-c984a8a038b5 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Flavor limits 0:0:0 {{(pid=118887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 03:12:16.489559 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.virt.hardware [None req-d87210a2-204d-4733-99cc-c984a8a038b5 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Image limits 0:0:0 {{(pid=118887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 03:12:16.491759 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.virt.hardware [None req-d87210a2-204d-4733-99cc-c984a8a038b5 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Flavor pref 0:0:0 {{(pid=118887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 03:12:16.492996 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.virt.hardware [None req-d87210a2-204d-4733-99cc-c984a8a038b5 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Image pref 0:0:0 {{(pid=118887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 03:12:16.493604 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-2b14b2e9-a33b-4fed-afe6-94c5593b5b79 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4443729a5a5341b6ad64f6fa131a5a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd03f03d21e9e42fb91606306241a3fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:16.494343 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.virt.hardware [None req-d87210a2-204d-4733-99cc-c984a8a038b5 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 03:12:16.503901 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-2b14b2e9-a33b-4fed-afe6-94c5593b5b79 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] 10.222.0.27 "GET /compute/v2.1/servers/f4241d22-757d-4baa-bee5-476e3fab96a8" status: 200 len: 1315 microversion: 2.1 time: 0.726760 Oct 17 03:12:16.515312 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 34/57] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:12:15 2022] GET /compute/v2.1/servers/f4241d22-757d-4baa-bee5-476e3fab96a8 => generated 1315 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:12:16.522085 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-a6327515-04d2-4344-aa69-dffc5695211f tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:12:16.523628 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-a6327515-04d2-4344-aa69-dffc5695211f tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: f430d340-f7ff-4805-bd00-69eeaf33250d] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:12:16.526677 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-d87210a2-204d-4733-99cc-c984a8a038b5 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:16.527184 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-d87210a2-204d-4733-99cc-c984a8a038b5 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:16.528440 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-d87210a2-204d-4733-99cc-c984a8a038b5 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:16.531601 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-d87210a2-204d-4733-99cc-c984a8a038b5 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:16.532230 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-d87210a2-204d-4733-99cc-c984a8a038b5 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:16.533345 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-d87210a2-204d-4733-99cc-c984a8a038b5 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:16.545252 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-a6327515-04d2-4344-aa69-dffc5695211f tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:16.545752 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-a6327515-04d2-4344-aa69-dffc5695211f tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:16.546187 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-a6327515-04d2-4344-aa69-dffc5695211f tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:16.546972 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-a6327515-04d2-4344-aa69-dffc5695211f tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:16.547382 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-a6327515-04d2-4344-aa69-dffc5695211f tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:16.547807 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-a6327515-04d2-4344-aa69-dffc5695211f tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:16.563547 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.quota [None req-d87210a2-204d-4733-99cc-c984a8a038b5 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Getting quotas for project 618cf0b3507845909bb27c13460d1d6c. Resources: {'instances', 'cores', 'ram'} {{(pid=118887) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 03:12:16.568203 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.quota [None req-d87210a2-204d-4733-99cc-c984a8a038b5 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Getting quotas for user 1c786544e8fb4e8e8c3a4990a0f36725 and project 618cf0b3507845909bb27c13460d1d6c. Resources: {'instances', 'cores', 'ram'} {{(pid=118887) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 03:12:16.583987 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-d87210a2-204d-4733-99cc-c984a8a038b5 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Going to run 1 instances... {{(pid=118887) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 03:12:16.587282 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-d87210a2-204d-4733-99cc-c984a8a038b5 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] [instance: 4fc83673-1557-4eb9-b80b-825364198d8a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e6d41914-f1bc-4b72-9113-1a69b3d0d83b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118887) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 03:12:16.656590 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG dbcounter [-] [118887] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=13 {{(pid=118887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:12:16.687957 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-d87210a2-204d-4733-99cc-c984a8a038b5 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 7.024977 Oct 17 03:12:16.696697 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 24/58] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 03:12:09 2022] POST /compute/v2.1/servers => generated 402 bytes in 7034 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 03:12:16.716143 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-154b2afe-8e18-489e-8562-091195a7fcee tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:12:16.718235 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-154b2afe-8e18-489e-8562-091195a7fcee tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] [instance: 7b220b35-d9ac-48e4-b898-3d4f6c7be835] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:12:16.767661 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-154b2afe-8e18-489e-8562-091195a7fcee tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:16.771063 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-154b2afe-8e18-489e-8562-091195a7fcee tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:16.773538 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-154b2afe-8e18-489e-8562-091195a7fcee tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:16.776787 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-154b2afe-8e18-489e-8562-091195a7fcee tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:16.778383 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-154b2afe-8e18-489e-8562-091195a7fcee tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:16.780383 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-154b2afe-8e18-489e-8562-091195a7fcee tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:16.960572 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG dbcounter [-] [118886] Writing DB stats nova_cell0:SELECT=22 {{(pid=118886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:12:17.859571 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-154b2afe-8e18-489e-8562-091195a7fcee tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce25db99a7b14d0bbaca41fff80e3da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5bad80dc0d74119b2a9cd5c1935e8d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:17.881316 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-154b2afe-8e18-489e-8562-091195a7fcee tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] 10.222.0.27 "GET /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835" status: 200 len: 1363 microversion: 2.1 time: 1.182517 Oct 17 03:12:17.916962 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 25/59] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:12:16 2022] GET /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835 => generated 1363 bytes in 1220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:12:17.926599 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-df353482-ead2-4578-a8e2-cff9bf0a293c tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:12:17.927477 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-df353482-ead2-4578-a8e2-cff9bf0a293c tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] [instance: 4fc83673-1557-4eb9-b80b-825364198d8a] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:12:17.935417 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-df353482-ead2-4578-a8e2-cff9bf0a293c tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:17.936134 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-df353482-ead2-4578-a8e2-cff9bf0a293c tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:17.936782 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-df353482-ead2-4578-a8e2-cff9bf0a293c tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:17.937951 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-df353482-ead2-4578-a8e2-cff9bf0a293c tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:17.938542 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-df353482-ead2-4578-a8e2-cff9bf0a293c tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:17.939446 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-df353482-ead2-4578-a8e2-cff9bf0a293c tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:18.330983 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-df353482-ead2-4578-a8e2-cff9bf0a293c tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c786544e8fb4e8e8c3a4990a0f36725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618cf0b3507845909bb27c13460d1d6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:18.346902 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-df353482-ead2-4578-a8e2-cff9bf0a293c tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] 10.222.0.27 "GET /compute/v2.1/servers/4fc83673-1557-4eb9-b80b-825364198d8a" status: 200 len: 1237 microversion: 2.1 time: 0.420507 Oct 17 03:12:18.349782 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 26/60] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:12:17 2022] GET /compute/v2.1/servers/4fc83673-1557-4eb9-b80b-825364198d8a => generated 1237 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:12:18.384702 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-35fdf76a-0cab-484c-aaac-0251d814883f tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:12:18.385573 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-35fdf76a-0cab-484c-aaac-0251d814883f tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 603ee2bf-bedf-4688-ac0a-77a2a50f33d7] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:12:18.408724 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-35fdf76a-0cab-484c-aaac-0251d814883f tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:18.409880 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-35fdf76a-0cab-484c-aaac-0251d814883f tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:18.410804 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-35fdf76a-0cab-484c-aaac-0251d814883f tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:18.411870 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-35fdf76a-0cab-484c-aaac-0251d814883f tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:18.412568 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-35fdf76a-0cab-484c-aaac-0251d814883f tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:18.413544 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-35fdf76a-0cab-484c-aaac-0251d814883f tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:18.787773 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-a6327515-04d2-4344-aa69-dffc5695211f tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1787a9ef7c44e28076aaa80c0152fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee21a91b84794e80b208fe72b7f1e010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:18.811129 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-a6327515-04d2-4344-aa69-dffc5695211f tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "GET /compute/v2.1/servers/f430d340-f7ff-4805-bd00-69eeaf33250d" status: 200 len: 1322 microversion: 2.1 time: 2.294362 Oct 17 03:12:18.816497 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 35/61] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:12:16 2022] GET /compute/v2.1/servers/f430d340-f7ff-4805-bd00-69eeaf33250d => generated 1322 bytes in 2300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:12:18.840185 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-f3c5f5e6-c82e-4e9e-a09c-04c09787724a tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:12:18.849507 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-f3c5f5e6-c82e-4e9e-a09c-04c09787724a tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] [instance: f4241d22-757d-4baa-bee5-476e3fab96a8] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:12:18.881394 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG dbcounter [-] [118886] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=8 {{(pid=118886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:12:18.890298 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-f3c5f5e6-c82e-4e9e-a09c-04c09787724a tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:18.890820 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-f3c5f5e6-c82e-4e9e-a09c-04c09787724a tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:18.895048 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-f3c5f5e6-c82e-4e9e-a09c-04c09787724a tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:18.902660 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-f3c5f5e6-c82e-4e9e-a09c-04c09787724a tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:18.905382 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-f3c5f5e6-c82e-4e9e-a09c-04c09787724a tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:18.907978 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-f3c5f5e6-c82e-4e9e-a09c-04c09787724a tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:19.572937 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-35fdf76a-0cab-484c-aaac-0251d814883f tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:19.588177 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-35fdf76a-0cab-484c-aaac-0251d814883f tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:19.590410 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-35fdf76a-0cab-484c-aaac-0251d814883f tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:19.594693 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-35fdf76a-0cab-484c-aaac-0251d814883f tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7" status: 200 len: 1407 microversion: 2.20 time: 1.243906 Oct 17 03:12:19.596062 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 27/62] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 03:12:18 2022] GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7 => generated 1407 bytes in 1246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:12:19.617672 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-f3c5f5e6-c82e-4e9e-a09c-04c09787724a tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4443729a5a5341b6ad64f6fa131a5a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd03f03d21e9e42fb91606306241a3fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:19.641833 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-f3c5f5e6-c82e-4e9e-a09c-04c09787724a tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] 10.222.0.27 "GET /compute/v2.1/servers/f4241d22-757d-4baa-bee5-476e3fab96a8" status: 200 len: 1315 microversion: 2.1 time: 0.823964 Oct 17 03:12:19.642419 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 36/63] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:12:18 2022] GET /compute/v2.1/servers/f4241d22-757d-4baa-bee5-476e3fab96a8 => generated 1315 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:12:19.689708 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [req-99e4b47a-4f78-4513-8072-fcaca4e96364 req-b2897a78-aa64-4630-81aa-93f2b443e49e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "603ee2bf-bedf-4688-ac0a-77a2a50f33d7", "tag": "faf2315a-88ad-4367-997b-65c1cf0209ee"}]} {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:12:19.703518 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [req-99e4b47a-4f78-4513-8072-fcaca4e96364 req-b2897a78-aa64-4630-81aa-93f2b443e49e service nova] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:19.704012 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [req-99e4b47a-4f78-4513-8072-fcaca4e96364 req-b2897a78-aa64-4630-81aa-93f2b443e49e service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:19.704630 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [req-99e4b47a-4f78-4513-8072-fcaca4e96364 req-b2897a78-aa64-4630-81aa-93f2b443e49e service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:19.728660 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.compute.server_external_events [req-99e4b47a-4f78-4513-8072-fcaca4e96364 req-b2897a78-aa64-4630-81aa-93f2b443e49e service nova] Creating event network-changed:faf2315a-88ad-4367-997b-65c1cf0209ee for instance 603ee2bf-bedf-4688-ac0a-77a2a50f33d7 on hv-cinder-84697 Oct 17 03:12:19.729256 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [req-99e4b47a-4f78-4513-8072-fcaca4e96364 req-b2897a78-aa64-4630-81aa-93f2b443e49e service nova] Acquiring lock "compute-rpcapi-router" {{(pid=118887) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 17 03:12:19.729699 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [req-99e4b47a-4f78-4513-8072-fcaca4e96364 req-b2897a78-aa64-4630-81aa-93f2b443e49e service nova] Acquired lock "compute-rpcapi-router" {{(pid=118887) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 17 03:12:19.730842 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-1d41118f-1312-4aac-8f9b-4f0afa7b2a55 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:19.731385 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-1d41118f-1312-4aac-8f9b-4f0afa7b2a55 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:19.731848 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-1d41118f-1312-4aac-8f9b-4f0afa7b2a55 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:19.732660 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-1d41118f-1312-4aac-8f9b-4f0afa7b2a55 None None] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:19.733178 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-1d41118f-1312-4aac-8f9b-4f0afa7b2a55 None None] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:19.733668 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-1d41118f-1312-4aac-8f9b-4f0afa7b2a55 None None] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:19.743368 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.compute.rpcapi [None req-1d41118f-1312-4aac-8f9b-4f0afa7b2a55 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 17 03:12:19.744246 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-1d41118f-1312-4aac-8f9b-4f0afa7b2a55 None None] Releasing lock "compute-rpcapi-router" {{(pid=118887) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 17 03:12:19.763042 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-1d41118f-1312-4aac-8f9b-4f0afa7b2a55 None None] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.163699 Oct 17 03:12:19.764907 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 28/64] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 03:12:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:12:19.772917 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-fb0324a1-dd1d-4402-9d96-405ac232fa7c tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:12:19.773859 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-fb0324a1-dd1d-4402-9d96-405ac232fa7c tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] [instance: 7b220b35-d9ac-48e4-b898-3d4f6c7be835] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:12:19.783981 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-fb0324a1-dd1d-4402-9d96-405ac232fa7c tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:19.784466 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-fb0324a1-dd1d-4402-9d96-405ac232fa7c tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:19.785074 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-fb0324a1-dd1d-4402-9d96-405ac232fa7c tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:19.787030 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-fb0324a1-dd1d-4402-9d96-405ac232fa7c tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:19.787722 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-fb0324a1-dd1d-4402-9d96-405ac232fa7c tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:19.788532 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-fb0324a1-dd1d-4402-9d96-405ac232fa7c tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:19.858383 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [req-6d285ca3-29f0-4423-9a32-880513d1e496 req-54c6c8e2-c593-4702-9753-2d5f40f72cdd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b220b35-d9ac-48e4-b898-3d4f6c7be835", "tag": "cf904496-4f8e-473c-8ea7-795ed5aefe57"}]} {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:12:19.872979 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [req-6d285ca3-29f0-4423-9a32-880513d1e496 req-54c6c8e2-c593-4702-9753-2d5f40f72cdd service nova] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:19.873798 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [req-6d285ca3-29f0-4423-9a32-880513d1e496 req-54c6c8e2-c593-4702-9753-2d5f40f72cdd service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:19.874440 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [req-6d285ca3-29f0-4423-9a32-880513d1e496 req-54c6c8e2-c593-4702-9753-2d5f40f72cdd service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:19.898694 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.compute.server_external_events [req-6d285ca3-29f0-4423-9a32-880513d1e496 req-54c6c8e2-c593-4702-9753-2d5f40f72cdd service nova] Creating event network-changed:cf904496-4f8e-473c-8ea7-795ed5aefe57 for instance 7b220b35-d9ac-48e4-b898-3d4f6c7be835 on hv-cinder-84697 Oct 17 03:12:19.899468 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [req-6d285ca3-29f0-4423-9a32-880513d1e496 req-54c6c8e2-c593-4702-9753-2d5f40f72cdd service nova] Acquiring lock "compute-rpcapi-router" {{(pid=118886) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 17 03:12:19.900032 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [req-6d285ca3-29f0-4423-9a32-880513d1e496 req-54c6c8e2-c593-4702-9753-2d5f40f72cdd service nova] Acquired lock "compute-rpcapi-router" {{(pid=118886) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 17 03:12:19.901603 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-02895c86-2ba0-45a1-a960-f8c808c4ba15 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:19.902538 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-02895c86-2ba0-45a1-a960-f8c808c4ba15 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:19.903218 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-02895c86-2ba0-45a1-a960-f8c808c4ba15 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:19.904048 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-02895c86-2ba0-45a1-a960-f8c808c4ba15 None None] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:19.904599 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-02895c86-2ba0-45a1-a960-f8c808c4ba15 None None] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:19.905091 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-02895c86-2ba0-45a1-a960-f8c808c4ba15 None None] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:19.916277 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.compute.rpcapi [None req-02895c86-2ba0-45a1-a960-f8c808c4ba15 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 17 03:12:19.917360 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-02895c86-2ba0-45a1-a960-f8c808c4ba15 None None] Releasing lock "compute-rpcapi-router" {{(pid=118886) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 17 03:12:19.944228 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-02895c86-2ba0-45a1-a960-f8c808c4ba15 None None] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.291301 Oct 17 03:12:19.945819 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 37/65] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 03:12:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:12:19.955483 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-84e3d3c4-de30-4905-a28e-1d67a05f5b0e tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:12:19.956382 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-84e3d3c4-de30-4905-a28e-1d67a05f5b0e tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] [instance: 4fc83673-1557-4eb9-b80b-825364198d8a] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:12:19.963220 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-84e3d3c4-de30-4905-a28e-1d67a05f5b0e tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:19.963709 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-84e3d3c4-de30-4905-a28e-1d67a05f5b0e tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:19.964143 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-84e3d3c4-de30-4905-a28e-1d67a05f5b0e tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:19.964836 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-84e3d3c4-de30-4905-a28e-1d67a05f5b0e tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:19.965438 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-84e3d3c4-de30-4905-a28e-1d67a05f5b0e tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:19.966013 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-84e3d3c4-de30-4905-a28e-1d67a05f5b0e tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:19.970824 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG dbcounter [-] [118886] Writing DB stats nova_cell1:SELECT=100 {{(pid=118886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:12:19.985937 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-fb0324a1-dd1d-4402-9d96-405ac232fa7c tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce25db99a7b14d0bbaca41fff80e3da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5bad80dc0d74119b2a9cd5c1935e8d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:19.994402 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-fb0324a1-dd1d-4402-9d96-405ac232fa7c tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] 10.222.0.27 "GET /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835" status: 200 len: 1363 microversion: 2.1 time: 0.228020 Oct 17 03:12:19.995068 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 29/66] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:12:19 2022] GET /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835 => generated 1363 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:12:20.000246 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-f4d19d77-e161-43ad-95ad-15f41d59d12a tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:12:20.000845 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-f4d19d77-e161-43ad-95ad-15f41d59d12a tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: f430d340-f7ff-4805-bd00-69eeaf33250d] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:12:20.007085 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-f4d19d77-e161-43ad-95ad-15f41d59d12a tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:20.007817 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-f4d19d77-e161-43ad-95ad-15f41d59d12a tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:20.008407 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-f4d19d77-e161-43ad-95ad-15f41d59d12a tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:20.009576 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-f4d19d77-e161-43ad-95ad-15f41d59d12a tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:20.010280 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-f4d19d77-e161-43ad-95ad-15f41d59d12a tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:20.010756 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-f4d19d77-e161-43ad-95ad-15f41d59d12a tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:20.055973 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-84e3d3c4-de30-4905-a28e-1d67a05f5b0e tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c786544e8fb4e8e8c3a4990a0f36725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618cf0b3507845909bb27c13460d1d6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:20.064899 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-84e3d3c4-de30-4905-a28e-1d67a05f5b0e tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] 10.222.0.27 "GET /compute/v2.1/servers/4fc83673-1557-4eb9-b80b-825364198d8a" status: 200 len: 1293 microversion: 2.1 time: 0.117773 Oct 17 03:12:20.065573 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 38/67] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:12:19 2022] GET /compute/v2.1/servers/4fc83673-1557-4eb9-b80b-825364198d8a => generated 1293 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:12:20.159723 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-f4d19d77-e161-43ad-95ad-15f41d59d12a tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1787a9ef7c44e28076aaa80c0152fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee21a91b84794e80b208fe72b7f1e010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:20.168152 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-f4d19d77-e161-43ad-95ad-15f41d59d12a tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "GET /compute/v2.1/servers/f430d340-f7ff-4805-bd00-69eeaf33250d" status: 200 len: 1322 microversion: 2.1 time: 0.171692 Oct 17 03:12:20.168822 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 30/68] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:12:19 2022] GET /compute/v2.1/servers/f430d340-f7ff-4805-bd00-69eeaf33250d => generated 1322 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:12:20.620759 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-5b6bba0d-8d3c-44d4-a886-19ef7f82e30c tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:12:20.621359 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-5b6bba0d-8d3c-44d4-a886-19ef7f82e30c tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 603ee2bf-bedf-4688-ac0a-77a2a50f33d7] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:12:20.627924 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-5b6bba0d-8d3c-44d4-a886-19ef7f82e30c tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:20.628403 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-5b6bba0d-8d3c-44d4-a886-19ef7f82e30c tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:20.628836 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-5b6bba0d-8d3c-44d4-a886-19ef7f82e30c tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:20.629519 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-5b6bba0d-8d3c-44d4-a886-19ef7f82e30c tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:20.629967 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-5b6bba0d-8d3c-44d4-a886-19ef7f82e30c tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:20.630386 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-5b6bba0d-8d3c-44d4-a886-19ef7f82e30c tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:20.666482 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-3b47d22f-bd1a-40f6-9060-2e3ae1ba7591 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:12:20.667900 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-3b47d22f-bd1a-40f6-9060-2e3ae1ba7591 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] [instance: f4241d22-757d-4baa-bee5-476e3fab96a8] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:12:20.677094 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-3b47d22f-bd1a-40f6-9060-2e3ae1ba7591 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:20.677856 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-3b47d22f-bd1a-40f6-9060-2e3ae1ba7591 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:20.678301 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-3b47d22f-bd1a-40f6-9060-2e3ae1ba7591 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:20.679070 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-3b47d22f-bd1a-40f6-9060-2e3ae1ba7591 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:20.679531 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-3b47d22f-bd1a-40f6-9060-2e3ae1ba7591 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:20.679955 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-3b47d22f-bd1a-40f6-9060-2e3ae1ba7591 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:20.783161 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-5b6bba0d-8d3c-44d4-a886-19ef7f82e30c tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:20.795912 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-5b6bba0d-8d3c-44d4-a886-19ef7f82e30c tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:20.797662 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-5b6bba0d-8d3c-44d4-a886-19ef7f82e30c tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:20.798952 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-5b6bba0d-8d3c-44d4-a886-19ef7f82e30c tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7" status: 200 len: 1407 microversion: 2.20 time: 0.181989 Oct 17 03:12:20.799809 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 39/69] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 03:12:20 2022] GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7 => generated 1407 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:12:20.841539 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-3b47d22f-bd1a-40f6-9060-2e3ae1ba7591 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4443729a5a5341b6ad64f6fa131a5a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd03f03d21e9e42fb91606306241a3fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:20.849422 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-3b47d22f-bd1a-40f6-9060-2e3ae1ba7591 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] 10.222.0.27 "GET /compute/v2.1/servers/f4241d22-757d-4baa-bee5-476e3fab96a8" status: 200 len: 1315 microversion: 2.1 time: 0.187411 Oct 17 03:12:20.850138 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 31/70] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:12:20 2022] GET /compute/v2.1/servers/f4241d22-757d-4baa-bee5-476e3fab96a8 => generated 1315 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:12:21.017406 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-510c3335-6b05-4fc0-891f-cd44372d2c53 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:12:21.018013 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-510c3335-6b05-4fc0-891f-cd44372d2c53 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] [instance: 7b220b35-d9ac-48e4-b898-3d4f6c7be835] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:12:21.024400 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-510c3335-6b05-4fc0-891f-cd44372d2c53 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:21.024881 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-510c3335-6b05-4fc0-891f-cd44372d2c53 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:21.025309 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-510c3335-6b05-4fc0-891f-cd44372d2c53 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:21.025995 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-510c3335-6b05-4fc0-891f-cd44372d2c53 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:21.026698 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-510c3335-6b05-4fc0-891f-cd44372d2c53 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:21.027149 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-510c3335-6b05-4fc0-891f-cd44372d2c53 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:21.088150 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-9edc3fd7-605e-43da-b6a2-a683e82bbc7b tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:12:21.088955 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-9edc3fd7-605e-43da-b6a2-a683e82bbc7b tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] [instance: 4fc83673-1557-4eb9-b80b-825364198d8a] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:12:21.099587 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-9edc3fd7-605e-43da-b6a2-a683e82bbc7b tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:21.101731 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-9edc3fd7-605e-43da-b6a2-a683e82bbc7b tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:21.103917 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-9edc3fd7-605e-43da-b6a2-a683e82bbc7b tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:21.104866 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-9edc3fd7-605e-43da-b6a2-a683e82bbc7b tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:21.106199 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-9edc3fd7-605e-43da-b6a2-a683e82bbc7b tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:21.106718 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-9edc3fd7-605e-43da-b6a2-a683e82bbc7b tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:21.175834 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-9edc3fd7-605e-43da-b6a2-a683e82bbc7b tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c786544e8fb4e8e8c3a4990a0f36725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618cf0b3507845909bb27c13460d1d6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:21.184158 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-9edc3fd7-605e-43da-b6a2-a683e82bbc7b tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] 10.222.0.27 "GET /compute/v2.1/servers/4fc83673-1557-4eb9-b80b-825364198d8a" status: 200 len: 1293 microversion: 2.1 time: 0.100336 Oct 17 03:12:21.195393 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 32/71] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:12:21 2022] GET /compute/v2.1/servers/4fc83673-1557-4eb9-b80b-825364198d8a => generated 1293 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:12:21.197369 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-510c3335-6b05-4fc0-891f-cd44372d2c53 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce25db99a7b14d0bbaca41fff80e3da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5bad80dc0d74119b2a9cd5c1935e8d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:21.205085 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-82f5e408-d8a3-4573-8623-84e5dd537a4e tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:12:21.205705 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-82f5e408-d8a3-4573-8623-84e5dd537a4e tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: f430d340-f7ff-4805-bd00-69eeaf33250d] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:12:21.207544 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-510c3335-6b05-4fc0-891f-cd44372d2c53 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] 10.222.0.27 "GET /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835" status: 200 len: 1363 microversion: 2.1 time: 0.193837 Oct 17 03:12:21.208327 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 40/72] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:12:21 2022] GET /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835 => generated 1363 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:12:21.217107 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-82f5e408-d8a3-4573-8623-84e5dd537a4e tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:21.217697 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-82f5e408-d8a3-4573-8623-84e5dd537a4e tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:21.218319 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-82f5e408-d8a3-4573-8623-84e5dd537a4e tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:21.219376 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-82f5e408-d8a3-4573-8623-84e5dd537a4e tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:21.220131 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-82f5e408-d8a3-4573-8623-84e5dd537a4e tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:21.220749 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-82f5e408-d8a3-4573-8623-84e5dd537a4e tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:21.371967 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-82f5e408-d8a3-4573-8623-84e5dd537a4e tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1787a9ef7c44e28076aaa80c0152fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee21a91b84794e80b208fe72b7f1e010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:21.379680 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-82f5e408-d8a3-4573-8623-84e5dd537a4e tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "GET /compute/v2.1/servers/f430d340-f7ff-4805-bd00-69eeaf33250d" status: 200 len: 1322 microversion: 2.1 time: 0.183232 Oct 17 03:12:21.380250 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 33/73] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:12:21 2022] GET /compute/v2.1/servers/f430d340-f7ff-4805-bd00-69eeaf33250d => generated 1322 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:12:21.781570 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [req-971eb285-1d66-4798-9d3e-5d8ad2cfb8df req-f857cfe1-cc4b-45ea-a40e-86d4b14440f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4241d22-757d-4baa-bee5-476e3fab96a8", "tag": "824256fe-bd04-430c-90af-ea00257587d7"}, {"name": "network-changed", "server_uuid": "f430d340-f7ff-4805-bd00-69eeaf33250d", "tag": "5c656ce8-361e-4b32-8e55-8e2061a8f354"}]} {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:12:21.793645 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [req-971eb285-1d66-4798-9d3e-5d8ad2cfb8df req-f857cfe1-cc4b-45ea-a40e-86d4b14440f2 service nova] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:21.794692 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [req-971eb285-1d66-4798-9d3e-5d8ad2cfb8df req-f857cfe1-cc4b-45ea-a40e-86d4b14440f2 service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:21.795387 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [req-971eb285-1d66-4798-9d3e-5d8ad2cfb8df req-f857cfe1-cc4b-45ea-a40e-86d4b14440f2 service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:21.814624 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.compute.server_external_events [req-971eb285-1d66-4798-9d3e-5d8ad2cfb8df req-f857cfe1-cc4b-45ea-a40e-86d4b14440f2 service nova] Creating event network-changed:824256fe-bd04-430c-90af-ea00257587d7 for instance f4241d22-757d-4baa-bee5-476e3fab96a8 on hv-cinder-84697 Oct 17 03:12:21.815416 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.compute.server_external_events [req-971eb285-1d66-4798-9d3e-5d8ad2cfb8df req-f857cfe1-cc4b-45ea-a40e-86d4b14440f2 service nova] Creating event network-changed:5c656ce8-361e-4b32-8e55-8e2061a8f354 for instance f430d340-f7ff-4805-bd00-69eeaf33250d on hv-cinder-84697 Oct 17 03:12:21.824133 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-c8780f2d-d892-4af2-9372-f5582e0cd6b2 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:12:21.825309 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-c8780f2d-d892-4af2-9372-f5582e0cd6b2 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 603ee2bf-bedf-4688-ac0a-77a2a50f33d7] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:12:21.835448 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [req-971eb285-1d66-4798-9d3e-5d8ad2cfb8df req-f857cfe1-cc4b-45ea-a40e-86d4b14440f2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.057003 Oct 17 03:12:21.838284 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-c8780f2d-d892-4af2-9372-f5582e0cd6b2 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:21.839066 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-c8780f2d-d892-4af2-9372-f5582e0cd6b2 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:21.839975 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-c8780f2d-d892-4af2-9372-f5582e0cd6b2 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:21.841803 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-c8780f2d-d892-4af2-9372-f5582e0cd6b2 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:21.842334 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 41/74] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 03:12:21 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 03:12:21.843048 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-c8780f2d-d892-4af2-9372-f5582e0cd6b2 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:21.843720 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-c8780f2d-d892-4af2-9372-f5582e0cd6b2 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:21.879646 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-c5322a8c-152d-4a70-b9ac-51b1bfc38f7a tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:12:21.880443 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-c5322a8c-152d-4a70-b9ac-51b1bfc38f7a tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] [instance: f4241d22-757d-4baa-bee5-476e3fab96a8] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:12:21.891596 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-c5322a8c-152d-4a70-b9ac-51b1bfc38f7a tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:21.891596 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-c5322a8c-152d-4a70-b9ac-51b1bfc38f7a tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:21.891596 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-c5322a8c-152d-4a70-b9ac-51b1bfc38f7a tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:21.891596 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-c5322a8c-152d-4a70-b9ac-51b1bfc38f7a tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:21.891879 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-c5322a8c-152d-4a70-b9ac-51b1bfc38f7a tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:21.891879 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-c5322a8c-152d-4a70-b9ac-51b1bfc38f7a tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:22.036695 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-c8780f2d-d892-4af2-9372-f5582e0cd6b2 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:22.048514 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-c8780f2d-d892-4af2-9372-f5582e0cd6b2 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:22.051095 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-c8780f2d-d892-4af2-9372-f5582e0cd6b2 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:22.053074 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-c8780f2d-d892-4af2-9372-f5582e0cd6b2 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7" status: 200 len: 1407 microversion: 2.20 time: 0.232632 Oct 17 03:12:22.056374 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 34/75] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 03:12:21 2022] GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7 => generated 1407 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 03:12:22.064545 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [req-cdedefff-253e-464b-bcc4-9e448e21d9b1 req-bf0b3965-4ec0-43bc-a5ae-6d9e5ee4e95d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90f2768b-8259-439c-af06-7eff342615ee", "tag": "c31f984d-a48a-493a-8e53-83388b4caabf"}]} {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:12:22.087427 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [req-cdedefff-253e-464b-bcc4-9e448e21d9b1 req-bf0b3965-4ec0-43bc-a5ae-6d9e5ee4e95d service nova] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:22.088524 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [req-cdedefff-253e-464b-bcc4-9e448e21d9b1 req-bf0b3965-4ec0-43bc-a5ae-6d9e5ee4e95d service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:22.089414 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [req-cdedefff-253e-464b-bcc4-9e448e21d9b1 req-bf0b3965-4ec0-43bc-a5ae-6d9e5ee4e95d service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:22.102814 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.compute.server_external_events [req-cdedefff-253e-464b-bcc4-9e448e21d9b1 req-bf0b3965-4ec0-43bc-a5ae-6d9e5ee4e95d service nova] Creating event network-changed:c31f984d-a48a-493a-8e53-83388b4caabf for instance 90f2768b-8259-439c-af06-7eff342615ee on hv-cinder-84697 Oct 17 03:12:22.112543 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [req-cdedefff-253e-464b-bcc4-9e448e21d9b1 req-bf0b3965-4ec0-43bc-a5ae-6d9e5ee4e95d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054283 Oct 17 03:12:22.112737 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-c5322a8c-152d-4a70-b9ac-51b1bfc38f7a tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4443729a5a5341b6ad64f6fa131a5a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd03f03d21e9e42fb91606306241a3fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:22.116505 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 35/76] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 03:12:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:12:22.123601 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-c5322a8c-152d-4a70-b9ac-51b1bfc38f7a tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] 10.222.0.27 "GET /compute/v2.1/servers/f4241d22-757d-4baa-bee5-476e3fab96a8" status: 200 len: 1315 microversion: 2.1 time: 0.248420 Oct 17 03:12:22.124684 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 42/77] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:12:21 2022] GET /compute/v2.1/servers/f4241d22-757d-4baa-bee5-476e3fab96a8 => generated 1315 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:12:22.212130 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-0e74e643-c722-4a1e-becf-af5a6af05c59 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:12:22.218481 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-0e74e643-c722-4a1e-becf-af5a6af05c59 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] [instance: 4fc83673-1557-4eb9-b80b-825364198d8a] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:12:22.231953 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-0e74e643-c722-4a1e-becf-af5a6af05c59 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:22.232437 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-0e74e643-c722-4a1e-becf-af5a6af05c59 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:22.232866 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-0e74e643-c722-4a1e-becf-af5a6af05c59 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:22.233563 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-0e74e643-c722-4a1e-becf-af5a6af05c59 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:22.234166 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-0e74e643-c722-4a1e-becf-af5a6af05c59 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:22.234284 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-057e9154-2f84-4fb2-ab0a-9bfa1e2ddbeb tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:12:22.235526 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-057e9154-2f84-4fb2-ab0a-9bfa1e2ddbeb tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] [instance: 7b220b35-d9ac-48e4-b898-3d4f6c7be835] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:12:22.238856 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-0e74e643-c722-4a1e-becf-af5a6af05c59 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:22.245879 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-057e9154-2f84-4fb2-ab0a-9bfa1e2ddbeb tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:22.248500 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-057e9154-2f84-4fb2-ab0a-9bfa1e2ddbeb tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:22.249078 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-057e9154-2f84-4fb2-ab0a-9bfa1e2ddbeb tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:22.249817 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-057e9154-2f84-4fb2-ab0a-9bfa1e2ddbeb tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:22.250444 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-057e9154-2f84-4fb2-ab0a-9bfa1e2ddbeb tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:22.251053 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-057e9154-2f84-4fb2-ab0a-9bfa1e2ddbeb tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:22.360694 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-0e74e643-c722-4a1e-becf-af5a6af05c59 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c786544e8fb4e8e8c3a4990a0f36725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618cf0b3507845909bb27c13460d1d6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:22.371247 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-0e74e643-c722-4a1e-becf-af5a6af05c59 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] 10.222.0.27 "GET /compute/v2.1/servers/4fc83673-1557-4eb9-b80b-825364198d8a" status: 200 len: 1293 microversion: 2.1 time: 0.165904 Oct 17 03:12:22.386896 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 36/78] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:12:22 2022] GET /compute/v2.1/servers/4fc83673-1557-4eb9-b80b-825364198d8a => generated 1293 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:12:22.406851 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-80398bda-8f4f-47f9-9ab5-47b2dfac7707 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:12:22.407570 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-80398bda-8f4f-47f9-9ab5-47b2dfac7707 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: f430d340-f7ff-4805-bd00-69eeaf33250d] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:12:22.432288 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-80398bda-8f4f-47f9-9ab5-47b2dfac7707 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:22.433016 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-80398bda-8f4f-47f9-9ab5-47b2dfac7707 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:22.433596 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-80398bda-8f4f-47f9-9ab5-47b2dfac7707 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:22.434430 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-80398bda-8f4f-47f9-9ab5-47b2dfac7707 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:22.435014 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-80398bda-8f4f-47f9-9ab5-47b2dfac7707 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:22.435890 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-80398bda-8f4f-47f9-9ab5-47b2dfac7707 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:22.558115 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-057e9154-2f84-4fb2-ab0a-9bfa1e2ddbeb tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce25db99a7b14d0bbaca41fff80e3da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5bad80dc0d74119b2a9cd5c1935e8d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:22.570521 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-057e9154-2f84-4fb2-ab0a-9bfa1e2ddbeb tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] 10.222.0.27 "GET /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835" status: 200 len: 1363 microversion: 2.1 time: 0.340557 Oct 17 03:12:22.577354 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 43/79] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:12:22 2022] GET /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835 => generated 1363 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:12:22.702890 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-80398bda-8f4f-47f9-9ab5-47b2dfac7707 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1787a9ef7c44e28076aaa80c0152fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee21a91b84794e80b208fe72b7f1e010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:22.713529 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-80398bda-8f4f-47f9-9ab5-47b2dfac7707 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "GET /compute/v2.1/servers/f430d340-f7ff-4805-bd00-69eeaf33250d" status: 200 len: 1322 microversion: 2.1 time: 0.313506 Oct 17 03:12:22.714146 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 37/80] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:12:22 2022] GET /compute/v2.1/servers/f430d340-f7ff-4805-bd00-69eeaf33250d => generated 1322 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:12:23.087100 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-2d325969-6242-43db-ba5b-23e5ef9a1dac tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:12:23.088059 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-2d325969-6242-43db-ba5b-23e5ef9a1dac tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 603ee2bf-bedf-4688-ac0a-77a2a50f33d7] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:12:23.094910 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-2d325969-6242-43db-ba5b-23e5ef9a1dac tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:23.095398 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-2d325969-6242-43db-ba5b-23e5ef9a1dac tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:23.095825 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-2d325969-6242-43db-ba5b-23e5ef9a1dac tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:23.096517 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-2d325969-6242-43db-ba5b-23e5ef9a1dac tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:23.096963 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-2d325969-6242-43db-ba5b-23e5ef9a1dac tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:23.097377 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-2d325969-6242-43db-ba5b-23e5ef9a1dac tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:23.148432 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-c09bdd13-5578-4373-90a0-c344644fc7ad tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:12:23.149728 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-c09bdd13-5578-4373-90a0-c344644fc7ad tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] [instance: f4241d22-757d-4baa-bee5-476e3fab96a8] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:12:23.164200 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-c09bdd13-5578-4373-90a0-c344644fc7ad tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:23.165036 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-c09bdd13-5578-4373-90a0-c344644fc7ad tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:23.171597 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-c09bdd13-5578-4373-90a0-c344644fc7ad tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:23.172354 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-c09bdd13-5578-4373-90a0-c344644fc7ad tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:23.172821 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-c09bdd13-5578-4373-90a0-c344644fc7ad tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:23.173250 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-c09bdd13-5578-4373-90a0-c344644fc7ad tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:23.177732 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG dbcounter [-] [118887] Writing DB stats nova_cell1:SELECT=100 {{(pid=118887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:12:23.279676 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-2d325969-6242-43db-ba5b-23e5ef9a1dac tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:23.291464 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-2d325969-6242-43db-ba5b-23e5ef9a1dac tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:23.293204 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-2d325969-6242-43db-ba5b-23e5ef9a1dac tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:23.295106 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-2d325969-6242-43db-ba5b-23e5ef9a1dac tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7" status: 200 len: 1407 microversion: 2.20 time: 0.212954 Oct 17 03:12:23.295861 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 44/81] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 03:12:23 2022] GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7 => generated 1407 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:12:23.387720 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-c09bdd13-5578-4373-90a0-c344644fc7ad tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4443729a5a5341b6ad64f6fa131a5a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd03f03d21e9e42fb91606306241a3fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:23.396464 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-c09bdd13-5578-4373-90a0-c344644fc7ad tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] 10.222.0.27 "GET /compute/v2.1/servers/f4241d22-757d-4baa-bee5-476e3fab96a8" status: 200 len: 1315 microversion: 2.1 time: 0.251870 Oct 17 03:12:23.396921 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-53ea1750-17cb-4ea4-9818-a29c3ba02756 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:12:23.397978 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 38/82] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:12:23 2022] GET /compute/v2.1/servers/f4241d22-757d-4baa-bee5-476e3fab96a8 => generated 1315 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:12:23.398504 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-53ea1750-17cb-4ea4-9818-a29c3ba02756 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] [instance: 4fc83673-1557-4eb9-b80b-825364198d8a] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:12:23.406539 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-53ea1750-17cb-4ea4-9818-a29c3ba02756 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:23.407689 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-53ea1750-17cb-4ea4-9818-a29c3ba02756 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:23.408486 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-53ea1750-17cb-4ea4-9818-a29c3ba02756 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:23.409425 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-53ea1750-17cb-4ea4-9818-a29c3ba02756 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:23.410104 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-53ea1750-17cb-4ea4-9818-a29c3ba02756 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:23.410732 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-53ea1750-17cb-4ea4-9818-a29c3ba02756 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:23.495993 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-53ea1750-17cb-4ea4-9818-a29c3ba02756 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c786544e8fb4e8e8c3a4990a0f36725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618cf0b3507845909bb27c13460d1d6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:23.509840 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-53ea1750-17cb-4ea4-9818-a29c3ba02756 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] 10.222.0.27 "GET /compute/v2.1/servers/4fc83673-1557-4eb9-b80b-825364198d8a" status: 200 len: 1293 microversion: 2.1 time: 0.117386 Oct 17 03:12:23.511129 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 45/83] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:12:23 2022] GET /compute/v2.1/servers/4fc83673-1557-4eb9-b80b-825364198d8a => generated 1293 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:12:23.612856 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-04a885d2-40a3-4d05-b3eb-b65e501b412f tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:12:23.613461 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-04a885d2-40a3-4d05-b3eb-b65e501b412f tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] [instance: 7b220b35-d9ac-48e4-b898-3d4f6c7be835] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:12:23.619899 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-04a885d2-40a3-4d05-b3eb-b65e501b412f tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:23.620370 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-04a885d2-40a3-4d05-b3eb-b65e501b412f tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:23.620805 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-04a885d2-40a3-4d05-b3eb-b65e501b412f tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:23.621512 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-04a885d2-40a3-4d05-b3eb-b65e501b412f tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:23.621954 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-04a885d2-40a3-4d05-b3eb-b65e501b412f tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:23.622365 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-04a885d2-40a3-4d05-b3eb-b65e501b412f tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:23.737405 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-493681fa-e9d3-4404-8c92-7d7a1de37bcb tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:12:23.738035 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-493681fa-e9d3-4404-8c92-7d7a1de37bcb tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: f430d340-f7ff-4805-bd00-69eeaf33250d] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:12:23.744718 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-493681fa-e9d3-4404-8c92-7d7a1de37bcb tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:23.747012 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-493681fa-e9d3-4404-8c92-7d7a1de37bcb tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:23.747584 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-493681fa-e9d3-4404-8c92-7d7a1de37bcb tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:23.748862 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-493681fa-e9d3-4404-8c92-7d7a1de37bcb tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:23.749336 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-493681fa-e9d3-4404-8c92-7d7a1de37bcb tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:23.749780 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-493681fa-e9d3-4404-8c92-7d7a1de37bcb tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:23.758332 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-04a885d2-40a3-4d05-b3eb-b65e501b412f tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce25db99a7b14d0bbaca41fff80e3da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5bad80dc0d74119b2a9cd5c1935e8d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:23.767487 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-04a885d2-40a3-4d05-b3eb-b65e501b412f tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] 10.222.0.27 "GET /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835" status: 200 len: 1363 microversion: 2.1 time: 0.158487 Oct 17 03:12:23.768287 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 39/84] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:12:23 2022] GET /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835 => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:12:23.878402 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-493681fa-e9d3-4404-8c92-7d7a1de37bcb tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1787a9ef7c44e28076aaa80c0152fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee21a91b84794e80b208fe72b7f1e010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:23.886263 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-493681fa-e9d3-4404-8c92-7d7a1de37bcb tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "GET /compute/v2.1/servers/f430d340-f7ff-4805-bd00-69eeaf33250d" status: 200 len: 1322 microversion: 2.1 time: 0.152627 Oct 17 03:12:23.886856 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 46/85] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:12:23 2022] GET /compute/v2.1/servers/f430d340-f7ff-4805-bd00-69eeaf33250d => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:12:24.324597 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-51f47c46-7a4d-4362-8493-d3d05f28dde7 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:12:24.325194 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-51f47c46-7a4d-4362-8493-d3d05f28dde7 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 603ee2bf-bedf-4688-ac0a-77a2a50f33d7] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:12:24.331010 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-51f47c46-7a4d-4362-8493-d3d05f28dde7 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:24.331489 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-51f47c46-7a4d-4362-8493-d3d05f28dde7 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:24.331914 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-51f47c46-7a4d-4362-8493-d3d05f28dde7 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:24.332588 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-51f47c46-7a4d-4362-8493-d3d05f28dde7 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:24.333034 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-51f47c46-7a4d-4362-8493-d3d05f28dde7 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:24.333453 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-51f47c46-7a4d-4362-8493-d3d05f28dde7 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:24.422934 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-8f2916ce-f891-4a6c-be79-d60a6aaae10b tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:12:24.423564 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-8f2916ce-f891-4a6c-be79-d60a6aaae10b tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] [instance: f4241d22-757d-4baa-bee5-476e3fab96a8] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:12:24.429516 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-8f2916ce-f891-4a6c-be79-d60a6aaae10b tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:24.429994 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-8f2916ce-f891-4a6c-be79-d60a6aaae10b tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:24.430559 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-8f2916ce-f891-4a6c-be79-d60a6aaae10b tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:24.431234 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-8f2916ce-f891-4a6c-be79-d60a6aaae10b tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:24.431677 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-8f2916ce-f891-4a6c-be79-d60a6aaae10b tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:24.432090 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-8f2916ce-f891-4a6c-be79-d60a6aaae10b tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:24.474181 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-51f47c46-7a4d-4362-8493-d3d05f28dde7 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:24.482510 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-51f47c46-7a4d-4362-8493-d3d05f28dde7 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:24.483995 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-51f47c46-7a4d-4362-8493-d3d05f28dde7 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:24.485124 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-51f47c46-7a4d-4362-8493-d3d05f28dde7 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7" status: 200 len: 1407 microversion: 2.20 time: 0.164389 Oct 17 03:12:24.485685 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 40/86] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 03:12:24 2022] GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7 => generated 1407 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 03:12:24.536894 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-d9a38d11-3f57-4463-a298-caa568203c78 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:12:24.537501 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-d9a38d11-3f57-4463-a298-caa568203c78 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] [instance: 4fc83673-1557-4eb9-b80b-825364198d8a] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:12:24.544238 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-d9a38d11-3f57-4463-a298-caa568203c78 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:24.544745 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-d9a38d11-3f57-4463-a298-caa568203c78 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:24.545182 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-d9a38d11-3f57-4463-a298-caa568203c78 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:24.545877 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-d9a38d11-3f57-4463-a298-caa568203c78 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:24.546328 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-d9a38d11-3f57-4463-a298-caa568203c78 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:24.546747 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-d9a38d11-3f57-4463-a298-caa568203c78 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:24.561380 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-8f2916ce-f891-4a6c-be79-d60a6aaae10b tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4443729a5a5341b6ad64f6fa131a5a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd03f03d21e9e42fb91606306241a3fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:24.569971 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-8f2916ce-f891-4a6c-be79-d60a6aaae10b tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] 10.222.0.27 "GET /compute/v2.1/servers/f4241d22-757d-4baa-bee5-476e3fab96a8" status: 200 len: 1315 microversion: 2.1 time: 0.150319 Oct 17 03:12:24.570552 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 47/87] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:12:24 2022] GET /compute/v2.1/servers/f4241d22-757d-4baa-bee5-476e3fab96a8 => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:12:24.608142 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-d9a38d11-3f57-4463-a298-caa568203c78 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c786544e8fb4e8e8c3a4990a0f36725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618cf0b3507845909bb27c13460d1d6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:24.615908 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-d9a38d11-3f57-4463-a298-caa568203c78 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] 10.222.0.27 "GET /compute/v2.1/servers/4fc83673-1557-4eb9-b80b-825364198d8a" status: 200 len: 1293 microversion: 2.1 time: 0.082867 Oct 17 03:12:24.617128 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 41/88] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:12:24 2022] GET /compute/v2.1/servers/4fc83673-1557-4eb9-b80b-825364198d8a => generated 1293 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:12:24.789432 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-75031d56-60be-4539-987a-ce24ec5321f0 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:12:24.790058 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-75031d56-60be-4539-987a-ce24ec5321f0 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] [instance: 7b220b35-d9ac-48e4-b898-3d4f6c7be835] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:12:24.796015 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-75031d56-60be-4539-987a-ce24ec5321f0 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:24.796485 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-75031d56-60be-4539-987a-ce24ec5321f0 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:24.796934 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-75031d56-60be-4539-987a-ce24ec5321f0 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:24.797884 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-75031d56-60be-4539-987a-ce24ec5321f0 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:24.798333 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-75031d56-60be-4539-987a-ce24ec5321f0 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:24.798747 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-75031d56-60be-4539-987a-ce24ec5321f0 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:24.909332 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-76becf3c-bf10-4198-986a-cfc54dacf3dd tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:12:24.909938 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-76becf3c-bf10-4198-986a-cfc54dacf3dd tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: f430d340-f7ff-4805-bd00-69eeaf33250d] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:12:24.915896 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-76becf3c-bf10-4198-986a-cfc54dacf3dd tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:24.916369 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-76becf3c-bf10-4198-986a-cfc54dacf3dd tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:24.916795 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-76becf3c-bf10-4198-986a-cfc54dacf3dd tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:24.917475 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-76becf3c-bf10-4198-986a-cfc54dacf3dd tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:24.917922 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-76becf3c-bf10-4198-986a-cfc54dacf3dd tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:24.918338 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-76becf3c-bf10-4198-986a-cfc54dacf3dd tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:24.930354 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-75031d56-60be-4539-987a-ce24ec5321f0 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce25db99a7b14d0bbaca41fff80e3da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5bad80dc0d74119b2a9cd5c1935e8d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:24.938033 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-75031d56-60be-4539-987a-ce24ec5321f0 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] 10.222.0.27 "GET /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835" status: 200 len: 1363 microversion: 2.1 time: 0.152503 Oct 17 03:12:24.938595 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 48/89] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:12:24 2022] GET /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:12:25.053161 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-76becf3c-bf10-4198-986a-cfc54dacf3dd tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1787a9ef7c44e28076aaa80c0152fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee21a91b84794e80b208fe72b7f1e010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:25.061221 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-76becf3c-bf10-4198-986a-cfc54dacf3dd tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "GET /compute/v2.1/servers/f430d340-f7ff-4805-bd00-69eeaf33250d" status: 200 len: 1322 microversion: 2.1 time: 0.155676 Oct 17 03:12:25.061775 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 42/90] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:12:24 2022] GET /compute/v2.1/servers/f430d340-f7ff-4805-bd00-69eeaf33250d => generated 1322 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:12:25.510733 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-198fceb6-3a12-4da2-934b-ed1c6d713feb tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:12:25.511569 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-198fceb6-3a12-4da2-934b-ed1c6d713feb tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 603ee2bf-bedf-4688-ac0a-77a2a50f33d7] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:12:25.522687 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-198fceb6-3a12-4da2-934b-ed1c6d713feb tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:25.523283 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-198fceb6-3a12-4da2-934b-ed1c6d713feb tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:25.524885 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-198fceb6-3a12-4da2-934b-ed1c6d713feb tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:25.525812 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-198fceb6-3a12-4da2-934b-ed1c6d713feb tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:25.527366 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-198fceb6-3a12-4da2-934b-ed1c6d713feb tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:25.527984 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-198fceb6-3a12-4da2-934b-ed1c6d713feb tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:25.595874 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-894007bc-255a-403d-b345-15b94779ab09 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:12:25.598641 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-894007bc-255a-403d-b345-15b94779ab09 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] [instance: f4241d22-757d-4baa-bee5-476e3fab96a8] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:12:25.615483 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-894007bc-255a-403d-b345-15b94779ab09 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:25.617971 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-894007bc-255a-403d-b345-15b94779ab09 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:25.618499 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-894007bc-255a-403d-b345-15b94779ab09 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:25.619474 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-894007bc-255a-403d-b345-15b94779ab09 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:25.619998 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-894007bc-255a-403d-b345-15b94779ab09 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:25.620485 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-894007bc-255a-403d-b345-15b94779ab09 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:25.887480 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-198fceb6-3a12-4da2-934b-ed1c6d713feb tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:25.897892 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-198fceb6-3a12-4da2-934b-ed1c6d713feb tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:25.905046 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-198fceb6-3a12-4da2-934b-ed1c6d713feb tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:25.908861 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-198fceb6-3a12-4da2-934b-ed1c6d713feb tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7" status: 200 len: 1407 microversion: 2.20 time: 0.402805 Oct 17 03:12:25.911133 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 49/91] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 03:12:25 2022] GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7 => generated 1407 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:12:25.917209 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-900e2f6e-ff78-44bb-895f-05f1c0396807 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:12:25.918696 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-900e2f6e-ff78-44bb-895f-05f1c0396807 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] [instance: 4fc83673-1557-4eb9-b80b-825364198d8a] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:12:25.926497 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-900e2f6e-ff78-44bb-895f-05f1c0396807 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:25.927269 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-900e2f6e-ff78-44bb-895f-05f1c0396807 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:25.927989 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-900e2f6e-ff78-44bb-895f-05f1c0396807 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:25.929024 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-900e2f6e-ff78-44bb-895f-05f1c0396807 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:25.929786 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-900e2f6e-ff78-44bb-895f-05f1c0396807 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:25.930466 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-900e2f6e-ff78-44bb-895f-05f1c0396807 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:26.001976 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-900e2f6e-ff78-44bb-895f-05f1c0396807 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c786544e8fb4e8e8c3a4990a0f36725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618cf0b3507845909bb27c13460d1d6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:26.010760 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-900e2f6e-ff78-44bb-895f-05f1c0396807 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] 10.222.0.27 "GET /compute/v2.1/servers/4fc83673-1557-4eb9-b80b-825364198d8a" status: 200 len: 1299 microversion: 2.1 time: 0.098008 Oct 17 03:12:26.011459 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 50/92] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:12:25 2022] GET /compute/v2.1/servers/4fc83673-1557-4eb9-b80b-825364198d8a => generated 1299 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:12:26.016184 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-68d0d793-191c-4681-8063-ec6224696bbc tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:12:26.016863 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-68d0d793-191c-4681-8063-ec6224696bbc tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] [instance: 7b220b35-d9ac-48e4-b898-3d4f6c7be835] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:12:26.023153 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-68d0d793-191c-4681-8063-ec6224696bbc tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:26.023846 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-68d0d793-191c-4681-8063-ec6224696bbc tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:26.024471 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-68d0d793-191c-4681-8063-ec6224696bbc tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:26.025364 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-68d0d793-191c-4681-8063-ec6224696bbc tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:26.026258 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-68d0d793-191c-4681-8063-ec6224696bbc tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:26.039265 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-68d0d793-191c-4681-8063-ec6224696bbc tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:26.071260 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-894007bc-255a-403d-b345-15b94779ab09 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4443729a5a5341b6ad64f6fa131a5a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd03f03d21e9e42fb91606306241a3fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:26.079841 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-894007bc-255a-403d-b345-15b94779ab09 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] 10.222.0.27 "GET /compute/v2.1/servers/f4241d22-757d-4baa-bee5-476e3fab96a8" status: 200 len: 1315 microversion: 2.1 time: 0.488513 Oct 17 03:12:26.080453 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 43/93] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:12:25 2022] GET /compute/v2.1/servers/f4241d22-757d-4baa-bee5-476e3fab96a8 => generated 1315 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:12:26.085286 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-8af10054-dffe-4429-b952-5484c87e2f03 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:12:26.085939 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-8af10054-dffe-4429-b952-5484c87e2f03 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: f430d340-f7ff-4805-bd00-69eeaf33250d] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:12:26.092476 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-8af10054-dffe-4429-b952-5484c87e2f03 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:26.093052 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-8af10054-dffe-4429-b952-5484c87e2f03 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:26.093527 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-8af10054-dffe-4429-b952-5484c87e2f03 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:26.094381 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-8af10054-dffe-4429-b952-5484c87e2f03 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:26.094889 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-8af10054-dffe-4429-b952-5484c87e2f03 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:26.095620 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-8af10054-dffe-4429-b952-5484c87e2f03 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:26.206447 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-68d0d793-191c-4681-8063-ec6224696bbc tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce25db99a7b14d0bbaca41fff80e3da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5bad80dc0d74119b2a9cd5c1935e8d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:26.217516 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-68d0d793-191c-4681-8063-ec6224696bbc tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] 10.222.0.27 "GET /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835" status: 200 len: 1363 microversion: 2.1 time: 0.204797 Oct 17 03:12:26.218109 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 51/94] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:12:26 2022] GET /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835 => generated 1363 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:12:26.253839 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-8af10054-dffe-4429-b952-5484c87e2f03 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1787a9ef7c44e28076aaa80c0152fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee21a91b84794e80b208fe72b7f1e010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:26.263155 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-8af10054-dffe-4429-b952-5484c87e2f03 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "GET /compute/v2.1/servers/f430d340-f7ff-4805-bd00-69eeaf33250d" status: 200 len: 1322 microversion: 2.1 time: 0.181626 Oct 17 03:12:26.263819 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 44/95] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:12:26 2022] GET /compute/v2.1/servers/f430d340-f7ff-4805-bd00-69eeaf33250d => generated 1322 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:12:26.939852 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-6e79b54c-53c7-4540-ba5d-c2b87f841d8a tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:12:26.940368 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-6e79b54c-53c7-4540-ba5d-c2b87f841d8a tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 603ee2bf-bedf-4688-ac0a-77a2a50f33d7] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:12:26.946747 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-6e79b54c-53c7-4540-ba5d-c2b87f841d8a tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:26.947254 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-6e79b54c-53c7-4540-ba5d-c2b87f841d8a tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:26.947704 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-6e79b54c-53c7-4540-ba5d-c2b87f841d8a tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:26.948514 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-6e79b54c-53c7-4540-ba5d-c2b87f841d8a tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:26.948996 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-6e79b54c-53c7-4540-ba5d-c2b87f841d8a tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:26.949486 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-6e79b54c-53c7-4540-ba5d-c2b87f841d8a tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:27.036270 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-3370865f-1681-47c9-ba1c-ebd633831705 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:12:27.036877 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-3370865f-1681-47c9-ba1c-ebd633831705 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] [instance: 4fc83673-1557-4eb9-b80b-825364198d8a] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:12:27.038987 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG dbcounter [-] [118887] Writing DB stats nova_cell0:SELECT=34 {{(pid=118887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:12:27.044541 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-3370865f-1681-47c9-ba1c-ebd633831705 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:27.045033 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-3370865f-1681-47c9-ba1c-ebd633831705 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:27.045470 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-3370865f-1681-47c9-ba1c-ebd633831705 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:27.046168 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-3370865f-1681-47c9-ba1c-ebd633831705 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:27.046619 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-3370865f-1681-47c9-ba1c-ebd633831705 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:27.047077 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-3370865f-1681-47c9-ba1c-ebd633831705 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:27.080514 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-6e79b54c-53c7-4540-ba5d-c2b87f841d8a tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:27.090914 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-6e79b54c-53c7-4540-ba5d-c2b87f841d8a tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:27.092330 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-6e79b54c-53c7-4540-ba5d-c2b87f841d8a tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:27.093428 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-6e79b54c-53c7-4540-ba5d-c2b87f841d8a tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7" status: 200 len: 1407 microversion: 2.20 time: 0.157519 Oct 17 03:12:27.094094 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 52/96] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 03:12:26 2022] GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7 => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:12:27.104545 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-320c246a-1f12-4526-87f4-ee0cf14560c6 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:12:27.105240 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-320c246a-1f12-4526-87f4-ee0cf14560c6 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] [instance: f4241d22-757d-4baa-bee5-476e3fab96a8] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:12:27.111386 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-320c246a-1f12-4526-87f4-ee0cf14560c6 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:27.111866 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-320c246a-1f12-4526-87f4-ee0cf14560c6 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:27.112330 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-320c246a-1f12-4526-87f4-ee0cf14560c6 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:27.113047 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-320c246a-1f12-4526-87f4-ee0cf14560c6 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:27.113497 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-320c246a-1f12-4526-87f4-ee0cf14560c6 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:27.113919 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-320c246a-1f12-4526-87f4-ee0cf14560c6 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:27.122428 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-3370865f-1681-47c9-ba1c-ebd633831705 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c786544e8fb4e8e8c3a4990a0f36725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618cf0b3507845909bb27c13460d1d6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:27.130241 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-3370865f-1681-47c9-ba1c-ebd633831705 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] 10.222.0.27 "GET /compute/v2.1/servers/4fc83673-1557-4eb9-b80b-825364198d8a" status: 200 len: 1299 microversion: 2.1 time: 0.097863 Oct 17 03:12:27.130810 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 45/97] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:12:27 2022] GET /compute/v2.1/servers/4fc83673-1557-4eb9-b80b-825364198d8a => generated 1299 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:12:27.240587 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-e683ea32-1453-4a7c-b416-b5eb1f63a795 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:12:27.241726 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-e683ea32-1453-4a7c-b416-b5eb1f63a795 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] [instance: 7b220b35-d9ac-48e4-b898-3d4f6c7be835] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:12:27.243159 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-320c246a-1f12-4526-87f4-ee0cf14560c6 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4443729a5a5341b6ad64f6fa131a5a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd03f03d21e9e42fb91606306241a3fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:27.247620 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-e683ea32-1453-4a7c-b416-b5eb1f63a795 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:27.248119 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-e683ea32-1453-4a7c-b416-b5eb1f63a795 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:27.248543 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-e683ea32-1453-4a7c-b416-b5eb1f63a795 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:27.249227 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-e683ea32-1453-4a7c-b416-b5eb1f63a795 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:27.249671 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-e683ea32-1453-4a7c-b416-b5eb1f63a795 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:27.250200 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-e683ea32-1453-4a7c-b416-b5eb1f63a795 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:27.250916 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-320c246a-1f12-4526-87f4-ee0cf14560c6 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] 10.222.0.27 "GET /compute/v2.1/servers/f4241d22-757d-4baa-bee5-476e3fab96a8" status: 200 len: 1315 microversion: 2.1 time: 0.150495 Oct 17 03:12:27.251514 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 53/98] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:12:27 2022] GET /compute/v2.1/servers/f4241d22-757d-4baa-bee5-476e3fab96a8 => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:12:27.287332 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-249ed9dc-b8ff-4e08-bf83-6f1134740649 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:12:27.288294 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-249ed9dc-b8ff-4e08-bf83-6f1134740649 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: f430d340-f7ff-4805-bd00-69eeaf33250d] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:12:27.296360 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-249ed9dc-b8ff-4e08-bf83-6f1134740649 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:27.296851 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-249ed9dc-b8ff-4e08-bf83-6f1134740649 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:27.297281 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-249ed9dc-b8ff-4e08-bf83-6f1134740649 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:27.297982 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-249ed9dc-b8ff-4e08-bf83-6f1134740649 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:27.298427 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-249ed9dc-b8ff-4e08-bf83-6f1134740649 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:27.298845 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-249ed9dc-b8ff-4e08-bf83-6f1134740649 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:27.383551 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-e683ea32-1453-4a7c-b416-b5eb1f63a795 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce25db99a7b14d0bbaca41fff80e3da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5bad80dc0d74119b2a9cd5c1935e8d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:27.391280 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-e683ea32-1453-4a7c-b416-b5eb1f63a795 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] 10.222.0.27 "GET /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835" status: 200 len: 1363 microversion: 2.1 time: 0.154826 Oct 17 03:12:27.391845 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 46/99] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:12:27 2022] GET /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835 => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:12:27.432651 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-249ed9dc-b8ff-4e08-bf83-6f1134740649 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1787a9ef7c44e28076aaa80c0152fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee21a91b84794e80b208fe72b7f1e010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:27.440358 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-249ed9dc-b8ff-4e08-bf83-6f1134740649 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "GET /compute/v2.1/servers/f430d340-f7ff-4805-bd00-69eeaf33250d" status: 200 len: 1322 microversion: 2.1 time: 0.156723 Oct 17 03:12:27.440979 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 54/100] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:12:27 2022] GET /compute/v2.1/servers/f430d340-f7ff-4805-bd00-69eeaf33250d => generated 1322 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:12:28.119050 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-6bbc7332-3765-4191-8ec8-207a7fbbfd01 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:12:28.119971 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-6bbc7332-3765-4191-8ec8-207a7fbbfd01 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 603ee2bf-bedf-4688-ac0a-77a2a50f33d7] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:12:28.125954 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-6bbc7332-3765-4191-8ec8-207a7fbbfd01 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:28.126434 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-6bbc7332-3765-4191-8ec8-207a7fbbfd01 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:28.126950 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-6bbc7332-3765-4191-8ec8-207a7fbbfd01 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:28.127568 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-6bbc7332-3765-4191-8ec8-207a7fbbfd01 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:28.128017 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-6bbc7332-3765-4191-8ec8-207a7fbbfd01 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:28.128435 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-6bbc7332-3765-4191-8ec8-207a7fbbfd01 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:28.154449 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-e4547c22-a466-4cf6-a6e8-44b8b19d4361 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:12:28.155867 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-e4547c22-a466-4cf6-a6e8-44b8b19d4361 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] [instance: 4fc83673-1557-4eb9-b80b-825364198d8a] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:12:28.162208 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-e4547c22-a466-4cf6-a6e8-44b8b19d4361 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:28.162810 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-e4547c22-a466-4cf6-a6e8-44b8b19d4361 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:28.163666 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-e4547c22-a466-4cf6-a6e8-44b8b19d4361 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:28.164894 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-e4547c22-a466-4cf6-a6e8-44b8b19d4361 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:28.165631 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-e4547c22-a466-4cf6-a6e8-44b8b19d4361 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:28.166050 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-e4547c22-a466-4cf6-a6e8-44b8b19d4361 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:28.185864 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG dbcounter [-] [118886] Writing DB stats nova_cell1:SELECT=100 {{(pid=118886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:12:28.233480 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-e4547c22-a466-4cf6-a6e8-44b8b19d4361 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c786544e8fb4e8e8c3a4990a0f36725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618cf0b3507845909bb27c13460d1d6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:28.242129 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-e4547c22-a466-4cf6-a6e8-44b8b19d4361 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] 10.222.0.27 "GET /compute/v2.1/servers/4fc83673-1557-4eb9-b80b-825364198d8a" status: 200 len: 1299 microversion: 2.1 time: 0.091885 Oct 17 03:12:28.242935 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 55/101] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:12:28 2022] GET /compute/v2.1/servers/4fc83673-1557-4eb9-b80b-825364198d8a => generated 1299 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:12:28.262843 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-6bbc7332-3765-4191-8ec8-207a7fbbfd01 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:28.271286 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-6bbc7332-3765-4191-8ec8-207a7fbbfd01 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:28.273361 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-6bbc7332-3765-4191-8ec8-207a7fbbfd01 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:28.274545 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-6bbc7332-3765-4191-8ec8-207a7fbbfd01 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7" status: 200 len: 1407 microversion: 2.20 time: 0.160543 Oct 17 03:12:28.275054 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-720663c0-d4ad-4adc-8813-d0940a7611c2 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:12:28.275661 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-720663c0-d4ad-4adc-8813-d0940a7611c2 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] [instance: f4241d22-757d-4baa-bee5-476e3fab96a8] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:12:28.280430 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 47/102] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 03:12:28 2022] GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7 => generated 1407 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:12:28.282047 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-720663c0-d4ad-4adc-8813-d0940a7611c2 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:28.282690 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-720663c0-d4ad-4adc-8813-d0940a7611c2 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:28.282956 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-720663c0-d4ad-4adc-8813-d0940a7611c2 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:28.283638 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-720663c0-d4ad-4adc-8813-d0940a7611c2 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:28.284082 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-720663c0-d4ad-4adc-8813-d0940a7611c2 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:28.284495 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-720663c0-d4ad-4adc-8813-d0940a7611c2 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:28.409683 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-720663c0-d4ad-4adc-8813-d0940a7611c2 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4443729a5a5341b6ad64f6fa131a5a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd03f03d21e9e42fb91606306241a3fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:28.415328 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-cf91b9d3-5fc1-48be-92e8-0de0b409dad4 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:12:28.415937 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-cf91b9d3-5fc1-48be-92e8-0de0b409dad4 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] [instance: 7b220b35-d9ac-48e4-b898-3d4f6c7be835] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:12:28.417918 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-720663c0-d4ad-4adc-8813-d0940a7611c2 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] 10.222.0.27 "GET /compute/v2.1/servers/f4241d22-757d-4baa-bee5-476e3fab96a8" status: 200 len: 1315 microversion: 2.1 time: 0.147075 Oct 17 03:12:28.418474 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 56/103] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:12:28 2022] GET /compute/v2.1/servers/f4241d22-757d-4baa-bee5-476e3fab96a8 => generated 1315 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:12:28.421851 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-cf91b9d3-5fc1-48be-92e8-0de0b409dad4 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:28.422333 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-cf91b9d3-5fc1-48be-92e8-0de0b409dad4 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:28.422764 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-cf91b9d3-5fc1-48be-92e8-0de0b409dad4 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:28.423480 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-cf91b9d3-5fc1-48be-92e8-0de0b409dad4 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:28.423933 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-cf91b9d3-5fc1-48be-92e8-0de0b409dad4 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:28.424354 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-cf91b9d3-5fc1-48be-92e8-0de0b409dad4 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:28.463198 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-3999cccf-7cf4-43f9-acb3-49bac164d0e2 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:12:28.463791 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-3999cccf-7cf4-43f9-acb3-49bac164d0e2 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: f430d340-f7ff-4805-bd00-69eeaf33250d] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:12:28.469585 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-3999cccf-7cf4-43f9-acb3-49bac164d0e2 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:28.470045 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-3999cccf-7cf4-43f9-acb3-49bac164d0e2 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:28.470471 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-3999cccf-7cf4-43f9-acb3-49bac164d0e2 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:28.471192 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-3999cccf-7cf4-43f9-acb3-49bac164d0e2 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:28.471643 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-3999cccf-7cf4-43f9-acb3-49bac164d0e2 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:28.472059 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-3999cccf-7cf4-43f9-acb3-49bac164d0e2 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:28.558972 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-cf91b9d3-5fc1-48be-92e8-0de0b409dad4 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce25db99a7b14d0bbaca41fff80e3da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5bad80dc0d74119b2a9cd5c1935e8d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:28.566690 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-cf91b9d3-5fc1-48be-92e8-0de0b409dad4 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] 10.222.0.27 "GET /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835" status: 200 len: 1363 microversion: 2.1 time: 0.155702 Oct 17 03:12:28.567292 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 48/104] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:12:28 2022] GET /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835 => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:12:28.604541 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-3999cccf-7cf4-43f9-acb3-49bac164d0e2 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1787a9ef7c44e28076aaa80c0152fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee21a91b84794e80b208fe72b7f1e010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:28.612211 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-3999cccf-7cf4-43f9-acb3-49bac164d0e2 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "GET /compute/v2.1/servers/f430d340-f7ff-4805-bd00-69eeaf33250d" status: 200 len: 1322 microversion: 2.1 time: 0.152726 Oct 17 03:12:28.612711 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 57/105] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:12:28 2022] GET /compute/v2.1/servers/f430d340-f7ff-4805-bd00-69eeaf33250d => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:12:29.263979 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-6cc720d9-af61-445f-8720-f5fc62c5c101 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:12:29.264581 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-6cc720d9-af61-445f-8720-f5fc62c5c101 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] [instance: 4fc83673-1557-4eb9-b80b-825364198d8a] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:12:29.270378 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-6cc720d9-af61-445f-8720-f5fc62c5c101 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:29.270851 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-6cc720d9-af61-445f-8720-f5fc62c5c101 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:29.271301 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-6cc720d9-af61-445f-8720-f5fc62c5c101 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:29.271968 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-6cc720d9-af61-445f-8720-f5fc62c5c101 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:29.273016 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-6cc720d9-af61-445f-8720-f5fc62c5c101 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:29.273522 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-6cc720d9-af61-445f-8720-f5fc62c5c101 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:29.300307 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-ba855211-e8e8-4f10-bb15-b5f9d6a362a6 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:12:29.300910 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-ba855211-e8e8-4f10-bb15-b5f9d6a362a6 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 603ee2bf-bedf-4688-ac0a-77a2a50f33d7] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:12:29.307995 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-ba855211-e8e8-4f10-bb15-b5f9d6a362a6 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:29.310064 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-ba855211-e8e8-4f10-bb15-b5f9d6a362a6 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:29.310064 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-ba855211-e8e8-4f10-bb15-b5f9d6a362a6 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:29.311039 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-ba855211-e8e8-4f10-bb15-b5f9d6a362a6 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:29.311566 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-ba855211-e8e8-4f10-bb15-b5f9d6a362a6 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:29.312049 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-ba855211-e8e8-4f10-bb15-b5f9d6a362a6 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:29.339607 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-6cc720d9-af61-445f-8720-f5fc62c5c101 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c786544e8fb4e8e8c3a4990a0f36725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618cf0b3507845909bb27c13460d1d6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:29.347131 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-6cc720d9-af61-445f-8720-f5fc62c5c101 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] 10.222.0.27 "GET /compute/v2.1/servers/4fc83673-1557-4eb9-b80b-825364198d8a" status: 200 len: 1299 microversion: 2.1 time: 0.086965 Oct 17 03:12:29.347688 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 49/106] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:12:29 2022] GET /compute/v2.1/servers/4fc83673-1557-4eb9-b80b-825364198d8a => generated 1299 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:12:29.441788 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-b30ac660-ff27-4482-a356-42f67845ef59 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:12:29.442562 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-b30ac660-ff27-4482-a356-42f67845ef59 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] [instance: f4241d22-757d-4baa-bee5-476e3fab96a8] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:12:29.443587 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-ba855211-e8e8-4f10-bb15-b5f9d6a362a6 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:29.449715 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-b30ac660-ff27-4482-a356-42f67845ef59 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:29.450250 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-b30ac660-ff27-4482-a356-42f67845ef59 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:29.450674 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-b30ac660-ff27-4482-a356-42f67845ef59 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:29.451435 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-b30ac660-ff27-4482-a356-42f67845ef59 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:29.451882 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-b30ac660-ff27-4482-a356-42f67845ef59 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:29.452421 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-b30ac660-ff27-4482-a356-42f67845ef59 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:29.453283 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-ba855211-e8e8-4f10-bb15-b5f9d6a362a6 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:29.454738 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-ba855211-e8e8-4f10-bb15-b5f9d6a362a6 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:29.455872 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-ba855211-e8e8-4f10-bb15-b5f9d6a362a6 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7" status: 200 len: 1407 microversion: 2.20 time: 0.159679 Oct 17 03:12:29.456445 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 58/107] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 03:12:29 2022] GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7 => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 03:12:29.589373 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-b30ac660-ff27-4482-a356-42f67845ef59 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4443729a5a5341b6ad64f6fa131a5a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd03f03d21e9e42fb91606306241a3fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:29.589558 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-b44fd9a5-8725-40e2-828f-6332c9752db9 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:12:29.590138 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-b44fd9a5-8725-40e2-828f-6332c9752db9 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] [instance: 7b220b35-d9ac-48e4-b898-3d4f6c7be835] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:12:29.596102 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-b44fd9a5-8725-40e2-828f-6332c9752db9 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:29.596651 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-b44fd9a5-8725-40e2-828f-6332c9752db9 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:29.597174 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-b30ac660-ff27-4482-a356-42f67845ef59 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] 10.222.0.27 "GET /compute/v2.1/servers/f4241d22-757d-4baa-bee5-476e3fab96a8" status: 200 len: 1315 microversion: 2.1 time: 0.159531 Oct 17 03:12:29.597294 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-b44fd9a5-8725-40e2-828f-6332c9752db9 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:29.597783 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 50/108] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:12:29 2022] GET /compute/v2.1/servers/f4241d22-757d-4baa-bee5-476e3fab96a8 => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:12:29.602800 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-b44fd9a5-8725-40e2-828f-6332c9752db9 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:29.603541 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-b44fd9a5-8725-40e2-828f-6332c9752db9 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:29.604132 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-b44fd9a5-8725-40e2-828f-6332c9752db9 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:29.634598 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-fbfb430f-a642-47ea-afb6-dec2a89fa6a8 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:12:29.635544 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-fbfb430f-a642-47ea-afb6-dec2a89fa6a8 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: f430d340-f7ff-4805-bd00-69eeaf33250d] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:12:29.642052 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-fbfb430f-a642-47ea-afb6-dec2a89fa6a8 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:29.642538 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-fbfb430f-a642-47ea-afb6-dec2a89fa6a8 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:29.642993 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-fbfb430f-a642-47ea-afb6-dec2a89fa6a8 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:29.643741 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-fbfb430f-a642-47ea-afb6-dec2a89fa6a8 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:29.644142 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-fbfb430f-a642-47ea-afb6-dec2a89fa6a8 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:29.644567 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-fbfb430f-a642-47ea-afb6-dec2a89fa6a8 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:29.739230 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-b44fd9a5-8725-40e2-828f-6332c9752db9 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce25db99a7b14d0bbaca41fff80e3da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5bad80dc0d74119b2a9cd5c1935e8d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:29.740485 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG dbcounter [-] [118887] Writing DB stats nova_cell0:SELECT=4 {{(pid=118887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:12:29.747879 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-b44fd9a5-8725-40e2-828f-6332c9752db9 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] 10.222.0.27 "GET /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835" status: 200 len: 1363 microversion: 2.1 time: 0.162308 Oct 17 03:12:29.748448 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 59/109] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:12:29 2022] GET /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835 => generated 1363 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:12:29.777823 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-fbfb430f-a642-47ea-afb6-dec2a89fa6a8 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1787a9ef7c44e28076aaa80c0152fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee21a91b84794e80b208fe72b7f1e010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:29.785691 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-fbfb430f-a642-47ea-afb6-dec2a89fa6a8 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "GET /compute/v2.1/servers/f430d340-f7ff-4805-bd00-69eeaf33250d" status: 200 len: 1322 microversion: 2.1 time: 0.155822 Oct 17 03:12:29.786269 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 51/110] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:12:29 2022] GET /compute/v2.1/servers/f430d340-f7ff-4805-bd00-69eeaf33250d => generated 1322 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:12:30.370015 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-b54e50c9-1d4b-44c6-93e5-ecc7575e6a23 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:12:30.371217 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-b54e50c9-1d4b-44c6-93e5-ecc7575e6a23 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] [instance: 4fc83673-1557-4eb9-b80b-825364198d8a] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:12:30.373388 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG dbcounter [-] [118886] Writing DB stats nova_cell0:SELECT=2 {{(pid=118886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:12:30.379465 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-b54e50c9-1d4b-44c6-93e5-ecc7575e6a23 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:30.379996 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-b54e50c9-1d4b-44c6-93e5-ecc7575e6a23 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:30.380441 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-b54e50c9-1d4b-44c6-93e5-ecc7575e6a23 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:30.381155 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-b54e50c9-1d4b-44c6-93e5-ecc7575e6a23 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:30.382340 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-b54e50c9-1d4b-44c6-93e5-ecc7575e6a23 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:30.382894 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-b54e50c9-1d4b-44c6-93e5-ecc7575e6a23 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:30.454181 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-b54e50c9-1d4b-44c6-93e5-ecc7575e6a23 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c786544e8fb4e8e8c3a4990a0f36725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618cf0b3507845909bb27c13460d1d6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:30.470854 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-b54e50c9-1d4b-44c6-93e5-ecc7575e6a23 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] 10.222.0.27 "GET /compute/v2.1/servers/4fc83673-1557-4eb9-b80b-825364198d8a" status: 200 len: 1299 microversion: 2.1 time: 0.105739 Oct 17 03:12:30.471453 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 60/111] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:12:30 2022] GET /compute/v2.1/servers/4fc83673-1557-4eb9-b80b-825364198d8a => generated 1299 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:12:30.492273 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-53faed55-46f4-4425-b6cd-341cb0d3ff30 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:12:30.492273 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-53faed55-46f4-4425-b6cd-341cb0d3ff30 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 603ee2bf-bedf-4688-ac0a-77a2a50f33d7] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:12:30.492870 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-53faed55-46f4-4425-b6cd-341cb0d3ff30 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:30.493399 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-53faed55-46f4-4425-b6cd-341cb0d3ff30 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:30.493945 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-53faed55-46f4-4425-b6cd-341cb0d3ff30 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:30.494667 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-53faed55-46f4-4425-b6cd-341cb0d3ff30 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:30.495151 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-53faed55-46f4-4425-b6cd-341cb0d3ff30 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:30.495563 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-53faed55-46f4-4425-b6cd-341cb0d3ff30 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:30.622502 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-0653cb2c-c2ac-4795-9ccf-e26c3f2fd74e tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:12:30.623830 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-0653cb2c-c2ac-4795-9ccf-e26c3f2fd74e tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] [instance: f4241d22-757d-4baa-bee5-476e3fab96a8] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:12:30.633069 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-0653cb2c-c2ac-4795-9ccf-e26c3f2fd74e tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:30.634049 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-0653cb2c-c2ac-4795-9ccf-e26c3f2fd74e tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:30.635377 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-0653cb2c-c2ac-4795-9ccf-e26c3f2fd74e tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:30.636559 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-0653cb2c-c2ac-4795-9ccf-e26c3f2fd74e tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:30.637224 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-0653cb2c-c2ac-4795-9ccf-e26c3f2fd74e tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:30.637849 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-0653cb2c-c2ac-4795-9ccf-e26c3f2fd74e tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:30.707475 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-53faed55-46f4-4425-b6cd-341cb0d3ff30 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:30.716421 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-53faed55-46f4-4425-b6cd-341cb0d3ff30 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:30.718144 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-53faed55-46f4-4425-b6cd-341cb0d3ff30 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:30.719756 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-53faed55-46f4-4425-b6cd-341cb0d3ff30 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7" status: 200 len: 1407 microversion: 2.20 time: 0.242675 Oct 17 03:12:30.720997 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 52/112] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 03:12:30 2022] GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7 => generated 1407 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:12:30.769468 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-00bd416e-bb93-4fee-b909-2367f9eb2c63 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:12:30.770074 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-00bd416e-bb93-4fee-b909-2367f9eb2c63 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] [instance: 7b220b35-d9ac-48e4-b898-3d4f6c7be835] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:12:30.786280 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-00bd416e-bb93-4fee-b909-2367f9eb2c63 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:30.787152 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-00bd416e-bb93-4fee-b909-2367f9eb2c63 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:30.787725 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-00bd416e-bb93-4fee-b909-2367f9eb2c63 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:30.789097 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-00bd416e-bb93-4fee-b909-2367f9eb2c63 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:30.789895 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-00bd416e-bb93-4fee-b909-2367f9eb2c63 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:30.790457 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-00bd416e-bb93-4fee-b909-2367f9eb2c63 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:31.062166 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-00bd416e-bb93-4fee-b909-2367f9eb2c63 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce25db99a7b14d0bbaca41fff80e3da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5bad80dc0d74119b2a9cd5c1935e8d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:31.070664 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-00bd416e-bb93-4fee-b909-2367f9eb2c63 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] 10.222.0.27 "GET /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835" status: 200 len: 1363 microversion: 2.1 time: 0.304881 Oct 17 03:12:31.071589 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 53/113] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:12:30 2022] GET /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835 => generated 1363 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:12:31.095232 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-62af6bd4-6d7d-4311-95ea-35e42fd52b57 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:12:31.096771 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-62af6bd4-6d7d-4311-95ea-35e42fd52b57 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: f430d340-f7ff-4805-bd00-69eeaf33250d] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:12:31.104652 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-62af6bd4-6d7d-4311-95ea-35e42fd52b57 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:31.105187 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-62af6bd4-6d7d-4311-95ea-35e42fd52b57 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:31.105788 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-62af6bd4-6d7d-4311-95ea-35e42fd52b57 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:31.106643 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-62af6bd4-6d7d-4311-95ea-35e42fd52b57 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:31.107365 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-62af6bd4-6d7d-4311-95ea-35e42fd52b57 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:31.107785 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-62af6bd4-6d7d-4311-95ea-35e42fd52b57 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:31.144592 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-0653cb2c-c2ac-4795-9ccf-e26c3f2fd74e tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4443729a5a5341b6ad64f6fa131a5a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd03f03d21e9e42fb91606306241a3fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:31.153586 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-0653cb2c-c2ac-4795-9ccf-e26c3f2fd74e tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] 10.222.0.27 "GET /compute/v2.1/servers/f4241d22-757d-4baa-bee5-476e3fab96a8" status: 200 len: 1315 microversion: 2.1 time: 0.537361 Oct 17 03:12:31.154207 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 61/114] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:12:30 2022] GET /compute/v2.1/servers/f4241d22-757d-4baa-bee5-476e3fab96a8 => generated 1315 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:12:31.309796 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-62af6bd4-6d7d-4311-95ea-35e42fd52b57 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1787a9ef7c44e28076aaa80c0152fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee21a91b84794e80b208fe72b7f1e010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:31.314242 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG dbcounter [-] [118887] Writing DB stats nova_cell1:SELECT=100 {{(pid=118887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:12:31.320582 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-62af6bd4-6d7d-4311-95ea-35e42fd52b57 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "GET /compute/v2.1/servers/f430d340-f7ff-4805-bd00-69eeaf33250d" status: 200 len: 1322 microversion: 2.1 time: 0.235688 Oct 17 03:12:31.321588 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 54/115] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:12:31 2022] GET /compute/v2.1/servers/f430d340-f7ff-4805-bd00-69eeaf33250d => generated 1322 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:12:31.497696 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-92ed85d5-9243-4b0f-83dd-02b8ac37dac3 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:12:31.499032 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-92ed85d5-9243-4b0f-83dd-02b8ac37dac3 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] [instance: 4fc83673-1557-4eb9-b80b-825364198d8a] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:12:31.505533 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-92ed85d5-9243-4b0f-83dd-02b8ac37dac3 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:31.507291 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-92ed85d5-9243-4b0f-83dd-02b8ac37dac3 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:31.507962 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-92ed85d5-9243-4b0f-83dd-02b8ac37dac3 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:31.509164 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-92ed85d5-9243-4b0f-83dd-02b8ac37dac3 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:31.509905 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-92ed85d5-9243-4b0f-83dd-02b8ac37dac3 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:31.510531 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-92ed85d5-9243-4b0f-83dd-02b8ac37dac3 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:31.653097 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-92ed85d5-9243-4b0f-83dd-02b8ac37dac3 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c786544e8fb4e8e8c3a4990a0f36725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618cf0b3507845909bb27c13460d1d6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:31.665705 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-92ed85d5-9243-4b0f-83dd-02b8ac37dac3 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] 10.222.0.27 "GET /compute/v2.1/servers/4fc83673-1557-4eb9-b80b-825364198d8a" status: 200 len: 1367 microversion: 2.1 time: 0.173367 Oct 17 03:12:31.666283 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 62/116] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:12:31 2022] GET /compute/v2.1/servers/4fc83673-1557-4eb9-b80b-825364198d8a => generated 1367 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:12:31.749225 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-c72846d6-f20b-47e0-8c6d-89f2d743759f tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:12:31.749843 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-c72846d6-f20b-47e0-8c6d-89f2d743759f tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 603ee2bf-bedf-4688-ac0a-77a2a50f33d7] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:12:31.756757 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-c72846d6-f20b-47e0-8c6d-89f2d743759f tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:31.757824 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-c72846d6-f20b-47e0-8c6d-89f2d743759f tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:31.759070 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-c72846d6-f20b-47e0-8c6d-89f2d743759f tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:31.760052 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-c72846d6-f20b-47e0-8c6d-89f2d743759f tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:31.760662 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-c72846d6-f20b-47e0-8c6d-89f2d743759f tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:31.761229 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-c72846d6-f20b-47e0-8c6d-89f2d743759f tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:32.005986 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-c72846d6-f20b-47e0-8c6d-89f2d743759f tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:32.017009 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-c72846d6-f20b-47e0-8c6d-89f2d743759f tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:32.021038 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-c72846d6-f20b-47e0-8c6d-89f2d743759f tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:32.022828 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-c72846d6-f20b-47e0-8c6d-89f2d743759f tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7" status: 200 len: 1407 microversion: 2.20 time: 0.278245 Oct 17 03:12:32.023711 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 55/117] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 03:12:31 2022] GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7 => generated 1407 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:12:32.099793 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-18e1a494-b760-4e4d-b85b-4326a01f3aa8 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:12:32.100950 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-18e1a494-b760-4e4d-b85b-4326a01f3aa8 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] [instance: 7b220b35-d9ac-48e4-b898-3d4f6c7be835] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:12:32.108376 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-18e1a494-b760-4e4d-b85b-4326a01f3aa8 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:32.109039 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-18e1a494-b760-4e4d-b85b-4326a01f3aa8 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:32.109655 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-18e1a494-b760-4e4d-b85b-4326a01f3aa8 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:32.110786 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-18e1a494-b760-4e4d-b85b-4326a01f3aa8 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:32.111645 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-18e1a494-b760-4e4d-b85b-4326a01f3aa8 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:32.112198 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-18e1a494-b760-4e4d-b85b-4326a01f3aa8 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:32.179373 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-b3910d58-c436-4d28-ba84-2ef1cbf06178 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:12:32.180449 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-b3910d58-c436-4d28-ba84-2ef1cbf06178 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] [instance: f4241d22-757d-4baa-bee5-476e3fab96a8] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:12:32.187401 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-b3910d58-c436-4d28-ba84-2ef1cbf06178 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:32.188128 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-b3910d58-c436-4d28-ba84-2ef1cbf06178 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:32.188828 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-b3910d58-c436-4d28-ba84-2ef1cbf06178 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:32.189999 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-b3910d58-c436-4d28-ba84-2ef1cbf06178 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:32.190680 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-b3910d58-c436-4d28-ba84-2ef1cbf06178 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:32.191438 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-b3910d58-c436-4d28-ba84-2ef1cbf06178 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:32.289945 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-18e1a494-b760-4e4d-b85b-4326a01f3aa8 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce25db99a7b14d0bbaca41fff80e3da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5bad80dc0d74119b2a9cd5c1935e8d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:32.299227 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-18e1a494-b760-4e4d-b85b-4326a01f3aa8 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] 10.222.0.27 "GET /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835" status: 200 len: 1363 microversion: 2.1 time: 0.204010 Oct 17 03:12:32.299811 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 63/118] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:12:32 2022] GET /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835 => generated 1363 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:12:32.349159 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-b3910d58-c436-4d28-ba84-2ef1cbf06178 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4443729a5a5341b6ad64f6fa131a5a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd03f03d21e9e42fb91606306241a3fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:32.352808 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-d2b09724-dad2-42f3-b401-640ac4e023c0 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:12:32.355147 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-d2b09724-dad2-42f3-b401-640ac4e023c0 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: f430d340-f7ff-4805-bd00-69eeaf33250d] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:12:32.366860 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-d2b09724-dad2-42f3-b401-640ac4e023c0 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:32.367034 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-b3910d58-c436-4d28-ba84-2ef1cbf06178 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] 10.222.0.27 "GET /compute/v2.1/servers/f4241d22-757d-4baa-bee5-476e3fab96a8" status: 200 len: 1315 microversion: 2.1 time: 0.192798 Oct 17 03:12:32.367580 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 56/119] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:12:32 2022] GET /compute/v2.1/servers/f4241d22-757d-4baa-bee5-476e3fab96a8 => generated 1315 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:12:32.368371 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-d2b09724-dad2-42f3-b401-640ac4e023c0 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:32.369205 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-d2b09724-dad2-42f3-b401-640ac4e023c0 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:32.370374 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-d2b09724-dad2-42f3-b401-640ac4e023c0 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:32.371638 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-d2b09724-dad2-42f3-b401-640ac4e023c0 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:32.372278 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-d2b09724-dad2-42f3-b401-640ac4e023c0 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:32.689747 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-ede7fdfd-5b68-4a6b-a506-fc29427fd1ae tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:12:32.690724 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-ede7fdfd-5b68-4a6b-a506-fc29427fd1ae tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] [instance: 4fc83673-1557-4eb9-b80b-825364198d8a] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:12:32.700722 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-ede7fdfd-5b68-4a6b-a506-fc29427fd1ae tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:32.701563 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-ede7fdfd-5b68-4a6b-a506-fc29427fd1ae tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:32.702181 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-ede7fdfd-5b68-4a6b-a506-fc29427fd1ae tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:32.704463 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-ede7fdfd-5b68-4a6b-a506-fc29427fd1ae tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:32.705673 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-ede7fdfd-5b68-4a6b-a506-fc29427fd1ae tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:32.706288 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-ede7fdfd-5b68-4a6b-a506-fc29427fd1ae tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:32.727960 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-d2b09724-dad2-42f3-b401-640ac4e023c0 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1787a9ef7c44e28076aaa80c0152fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee21a91b84794e80b208fe72b7f1e010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:32.743780 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-d2b09724-dad2-42f3-b401-640ac4e023c0 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "GET /compute/v2.1/servers/f430d340-f7ff-4805-bd00-69eeaf33250d" status: 200 len: 1322 microversion: 2.1 time: 0.400139 Oct 17 03:12:32.744361 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 64/120] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:12:32 2022] GET /compute/v2.1/servers/f430d340-f7ff-4805-bd00-69eeaf33250d => generated 1322 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:12:33.050655 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-c92a9954-9c87-43c3-b764-4e9fb3cdcd62 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:12:33.052548 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-ede7fdfd-5b68-4a6b-a506-fc29427fd1ae tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c786544e8fb4e8e8c3a4990a0f36725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618cf0b3507845909bb27c13460d1d6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:33.058334 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-c92a9954-9c87-43c3-b764-4e9fb3cdcd62 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 603ee2bf-bedf-4688-ac0a-77a2a50f33d7] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:12:33.069626 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-ede7fdfd-5b68-4a6b-a506-fc29427fd1ae tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] 10.222.0.27 "GET /compute/v2.1/servers/4fc83673-1557-4eb9-b80b-825364198d8a" status: 200 len: 1367 microversion: 2.1 time: 0.383346 Oct 17 03:12:33.072069 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-c92a9954-9c87-43c3-b764-4e9fb3cdcd62 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:33.088934 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 57/121] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:12:32 2022] GET /compute/v2.1/servers/4fc83673-1557-4eb9-b80b-825364198d8a => generated 1367 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:12:33.089794 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-c92a9954-9c87-43c3-b764-4e9fb3cdcd62 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:33.090520 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-c92a9954-9c87-43c3-b764-4e9fb3cdcd62 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:33.091632 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-c92a9954-9c87-43c3-b764-4e9fb3cdcd62 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:33.092194 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-c92a9954-9c87-43c3-b764-4e9fb3cdcd62 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:33.092645 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-c92a9954-9c87-43c3-b764-4e9fb3cdcd62 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:33.310697 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-c92a9954-9c87-43c3-b764-4e9fb3cdcd62 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:33.325708 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-c92a9954-9c87-43c3-b764-4e9fb3cdcd62 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:33.326433 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-d238eb7b-79fc-4dbb-b38b-b02ea1e49f07 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:12:33.327073 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-d238eb7b-79fc-4dbb-b38b-b02ea1e49f07 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] [instance: 7b220b35-d9ac-48e4-b898-3d4f6c7be835] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:12:33.345295 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-d238eb7b-79fc-4dbb-b38b-b02ea1e49f07 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:33.346150 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-d238eb7b-79fc-4dbb-b38b-b02ea1e49f07 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:33.346630 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-c92a9954-9c87-43c3-b764-4e9fb3cdcd62 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:33.346956 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-d238eb7b-79fc-4dbb-b38b-b02ea1e49f07 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:33.347872 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-d238eb7b-79fc-4dbb-b38b-b02ea1e49f07 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:33.351341 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-d238eb7b-79fc-4dbb-b38b-b02ea1e49f07 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:33.352236 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-c92a9954-9c87-43c3-b764-4e9fb3cdcd62 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7" status: 200 len: 1407 microversion: 2.20 time: 0.303179 Oct 17 03:12:33.352668 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-d238eb7b-79fc-4dbb-b38b-b02ea1e49f07 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:33.369131 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 65/122] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 03:12:33 2022] GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7 => generated 1407 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:12:33.393138 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-6fbd379d-6051-4576-ac2f-b2dd636d850f tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:12:33.394061 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-6fbd379d-6051-4576-ac2f-b2dd636d850f tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] [instance: f4241d22-757d-4baa-bee5-476e3fab96a8] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:12:33.410420 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-6fbd379d-6051-4576-ac2f-b2dd636d850f tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:33.411104 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-6fbd379d-6051-4576-ac2f-b2dd636d850f tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:33.412489 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-6fbd379d-6051-4576-ac2f-b2dd636d850f tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:33.416613 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-6fbd379d-6051-4576-ac2f-b2dd636d850f tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:33.418954 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-6fbd379d-6051-4576-ac2f-b2dd636d850f tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:33.420686 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-6fbd379d-6051-4576-ac2f-b2dd636d850f tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:33.652458 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-6fbd379d-6051-4576-ac2f-b2dd636d850f tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4443729a5a5341b6ad64f6fa131a5a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd03f03d21e9e42fb91606306241a3fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:33.668648 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-6fbd379d-6051-4576-ac2f-b2dd636d850f tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] 10.222.0.27 "GET /compute/v2.1/servers/f4241d22-757d-4baa-bee5-476e3fab96a8" status: 200 len: 1315 microversion: 2.1 time: 0.281632 Oct 17 03:12:33.674631 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 66/123] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:12:33 2022] GET /compute/v2.1/servers/f4241d22-757d-4baa-bee5-476e3fab96a8 => generated 1315 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:12:33.750213 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-d238eb7b-79fc-4dbb-b38b-b02ea1e49f07 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce25db99a7b14d0bbaca41fff80e3da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5bad80dc0d74119b2a9cd5c1935e8d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:33.760045 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-d238eb7b-79fc-4dbb-b38b-b02ea1e49f07 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] 10.222.0.27 "GET /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835" status: 200 len: 1363 microversion: 2.1 time: 0.439176 Oct 17 03:12:33.776148 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 58/124] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:12:33 2022] GET /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835 => generated 1363 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:12:33.781568 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-52a9f6c0-b055-43c8-9840-cb2799079e47 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:12:33.782559 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-52a9f6c0-b055-43c8-9840-cb2799079e47 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: f430d340-f7ff-4805-bd00-69eeaf33250d] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:12:33.792347 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-52a9f6c0-b055-43c8-9840-cb2799079e47 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:33.792844 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-52a9f6c0-b055-43c8-9840-cb2799079e47 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:33.794265 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-52a9f6c0-b055-43c8-9840-cb2799079e47 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:33.795636 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-52a9f6c0-b055-43c8-9840-cb2799079e47 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:33.796408 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-52a9f6c0-b055-43c8-9840-cb2799079e47 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:33.797271 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-52a9f6c0-b055-43c8-9840-cb2799079e47 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:33.933064 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [req-18e77a25-4afe-49bb-be0b-6569d1cca79b req-836443eb-2875-45ff-b33f-5fbcafb33621 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4fc83673-1557-4eb9-b80b-825364198d8a", "tag": "4df765f6-05e9-4846-a92d-d12d217252a8"}]} {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:12:33.956117 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [req-18e77a25-4afe-49bb-be0b-6569d1cca79b req-836443eb-2875-45ff-b33f-5fbcafb33621 service nova] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:33.957621 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [req-18e77a25-4afe-49bb-be0b-6569d1cca79b req-836443eb-2875-45ff-b33f-5fbcafb33621 service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:33.958099 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [req-18e77a25-4afe-49bb-be0b-6569d1cca79b req-836443eb-2875-45ff-b33f-5fbcafb33621 service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:34.016899 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.compute.server_external_events [req-18e77a25-4afe-49bb-be0b-6569d1cca79b req-836443eb-2875-45ff-b33f-5fbcafb33621 service nova] Creating event network-changed:4df765f6-05e9-4846-a92d-d12d217252a8 for instance 4fc83673-1557-4eb9-b80b-825364198d8a on hv-cinder-84697 Oct 17 03:12:34.028114 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [req-18e77a25-4afe-49bb-be0b-6569d1cca79b req-836443eb-2875-45ff-b33f-5fbcafb33621 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099516 Oct 17 03:12:34.028802 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 59/125] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 03:12:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:12:34.104435 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-995f8343-fcdd-46e0-9931-79a60dc3f70c tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:12:34.106137 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-995f8343-fcdd-46e0-9931-79a60dc3f70c tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] [instance: 4fc83673-1557-4eb9-b80b-825364198d8a] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:12:34.113210 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-995f8343-fcdd-46e0-9931-79a60dc3f70c tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:34.114135 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-995f8343-fcdd-46e0-9931-79a60dc3f70c tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:34.114779 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-995f8343-fcdd-46e0-9931-79a60dc3f70c tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:34.115994 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-995f8343-fcdd-46e0-9931-79a60dc3f70c tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:34.116704 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-995f8343-fcdd-46e0-9931-79a60dc3f70c tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:34.117413 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-995f8343-fcdd-46e0-9931-79a60dc3f70c tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:34.134358 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-52a9f6c0-b055-43c8-9840-cb2799079e47 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1787a9ef7c44e28076aaa80c0152fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee21a91b84794e80b208fe72b7f1e010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:34.142224 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-52a9f6c0-b055-43c8-9840-cb2799079e47 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "GET /compute/v2.1/servers/f430d340-f7ff-4805-bd00-69eeaf33250d" status: 200 len: 1322 microversion: 2.1 time: 0.364691 Oct 17 03:12:34.158162 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 67/126] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:12:33 2022] GET /compute/v2.1/servers/f430d340-f7ff-4805-bd00-69eeaf33250d => generated 1322 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:12:34.382216 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-c51d2dfc-ec1d-48ff-b29d-59b526e6f54c tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:12:34.383115 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-c51d2dfc-ec1d-48ff-b29d-59b526e6f54c tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 603ee2bf-bedf-4688-ac0a-77a2a50f33d7] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:12:34.392305 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-c51d2dfc-ec1d-48ff-b29d-59b526e6f54c tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:34.392826 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-c51d2dfc-ec1d-48ff-b29d-59b526e6f54c tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:34.393255 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-c51d2dfc-ec1d-48ff-b29d-59b526e6f54c tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:34.394785 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-c51d2dfc-ec1d-48ff-b29d-59b526e6f54c tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:34.395305 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-c51d2dfc-ec1d-48ff-b29d-59b526e6f54c tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:34.395818 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-c51d2dfc-ec1d-48ff-b29d-59b526e6f54c tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:34.666599 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-995f8343-fcdd-46e0-9931-79a60dc3f70c tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c786544e8fb4e8e8c3a4990a0f36725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618cf0b3507845909bb27c13460d1d6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:34.677348 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-995f8343-fcdd-46e0-9931-79a60dc3f70c tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] 10.222.0.27 "GET /compute/v2.1/servers/4fc83673-1557-4eb9-b80b-825364198d8a" status: 200 len: 1367 microversion: 2.1 time: 0.578012 Oct 17 03:12:34.678176 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 60/127] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:12:34 2022] GET /compute/v2.1/servers/4fc83673-1557-4eb9-b80b-825364198d8a => generated 1367 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:12:34.698108 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-a3fc62c3-b97f-4bab-a4a7-81b8b896825a tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:12:34.699435 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-c51d2dfc-ec1d-48ff-b29d-59b526e6f54c tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:34.700347 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-a3fc62c3-b97f-4bab-a4a7-81b8b896825a tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] [instance: f4241d22-757d-4baa-bee5-476e3fab96a8] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:12:34.709249 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-a3fc62c3-b97f-4bab-a4a7-81b8b896825a tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:34.710665 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-a3fc62c3-b97f-4bab-a4a7-81b8b896825a tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:34.711316 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-a3fc62c3-b97f-4bab-a4a7-81b8b896825a tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:34.711528 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-c51d2dfc-ec1d-48ff-b29d-59b526e6f54c tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:34.712505 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-a3fc62c3-b97f-4bab-a4a7-81b8b896825a tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:34.713091 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-a3fc62c3-b97f-4bab-a4a7-81b8b896825a tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:34.713710 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-a3fc62c3-b97f-4bab-a4a7-81b8b896825a tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:34.721095 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-c51d2dfc-ec1d-48ff-b29d-59b526e6f54c tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:34.722470 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-c51d2dfc-ec1d-48ff-b29d-59b526e6f54c tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7" status: 200 len: 1407 microversion: 2.20 time: 0.344567 Oct 17 03:12:34.723090 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 68/128] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 03:12:34 2022] GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7 => generated 1407 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:12:34.792774 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-4dcbc7a3-af4d-4980-9e75-8bc6e898b445 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:12:34.793390 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-4dcbc7a3-af4d-4980-9e75-8bc6e898b445 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] [instance: 7b220b35-d9ac-48e4-b898-3d4f6c7be835] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:12:34.804675 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-4dcbc7a3-af4d-4980-9e75-8bc6e898b445 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:34.805516 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-4dcbc7a3-af4d-4980-9e75-8bc6e898b445 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:34.808214 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-4dcbc7a3-af4d-4980-9e75-8bc6e898b445 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:34.810031 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-4dcbc7a3-af4d-4980-9e75-8bc6e898b445 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:34.815297 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-4dcbc7a3-af4d-4980-9e75-8bc6e898b445 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:34.816041 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-4dcbc7a3-af4d-4980-9e75-8bc6e898b445 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:35.054386 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-a3fc62c3-b97f-4bab-a4a7-81b8b896825a tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4443729a5a5341b6ad64f6fa131a5a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd03f03d21e9e42fb91606306241a3fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:35.063785 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-a3fc62c3-b97f-4bab-a4a7-81b8b896825a tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] 10.222.0.27 "GET /compute/v2.1/servers/f4241d22-757d-4baa-bee5-476e3fab96a8" status: 200 len: 1315 microversion: 2.1 time: 0.374865 Oct 17 03:12:35.064690 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 61/129] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:12:34 2022] GET /compute/v2.1/servers/f4241d22-757d-4baa-bee5-476e3fab96a8 => generated 1315 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:12:35.132899 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-4dcbc7a3-af4d-4980-9e75-8bc6e898b445 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce25db99a7b14d0bbaca41fff80e3da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5bad80dc0d74119b2a9cd5c1935e8d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:35.148337 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-4dcbc7a3-af4d-4980-9e75-8bc6e898b445 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] 10.222.0.27 "GET /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835" status: 200 len: 1363 microversion: 2.1 time: 0.361166 Oct 17 03:12:35.161276 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 69/130] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:12:34 2022] GET /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835 => generated 1363 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:12:35.177459 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-603c6415-0496-4f77-a239-5c6a8f0934c0 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:12:35.179469 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-603c6415-0496-4f77-a239-5c6a8f0934c0 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: f430d340-f7ff-4805-bd00-69eeaf33250d] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:12:35.191444 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-603c6415-0496-4f77-a239-5c6a8f0934c0 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:35.191966 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-603c6415-0496-4f77-a239-5c6a8f0934c0 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:35.192448 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-603c6415-0496-4f77-a239-5c6a8f0934c0 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:35.193344 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-603c6415-0496-4f77-a239-5c6a8f0934c0 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:35.194460 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-603c6415-0496-4f77-a239-5c6a8f0934c0 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:35.195032 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-603c6415-0496-4f77-a239-5c6a8f0934c0 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:35.392849 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-603c6415-0496-4f77-a239-5c6a8f0934c0 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1787a9ef7c44e28076aaa80c0152fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee21a91b84794e80b208fe72b7f1e010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:35.401102 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-603c6415-0496-4f77-a239-5c6a8f0934c0 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "GET /compute/v2.1/servers/f430d340-f7ff-4805-bd00-69eeaf33250d" status: 200 len: 1322 microversion: 2.1 time: 0.238130 Oct 17 03:12:35.415734 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 62/131] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:12:35 2022] GET /compute/v2.1/servers/f430d340-f7ff-4805-bd00-69eeaf33250d => generated 1322 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:12:35.704100 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-3fba604e-bfb4-485f-9d52-ec8f418ab945 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:12:35.704799 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-3fba604e-bfb4-485f-9d52-ec8f418ab945 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] [instance: 4fc83673-1557-4eb9-b80b-825364198d8a] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:12:35.711430 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-3fba604e-bfb4-485f-9d52-ec8f418ab945 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:35.711980 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-3fba604e-bfb4-485f-9d52-ec8f418ab945 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:35.712484 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-3fba604e-bfb4-485f-9d52-ec8f418ab945 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:35.713755 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-3fba604e-bfb4-485f-9d52-ec8f418ab945 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:35.713755 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-3fba604e-bfb4-485f-9d52-ec8f418ab945 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:35.714217 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-3fba604e-bfb4-485f-9d52-ec8f418ab945 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:35.748340 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-90c488d6-71f3-4ca1-9ba6-0b7e6fe0c540 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:12:35.749203 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-90c488d6-71f3-4ca1-9ba6-0b7e6fe0c540 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 603ee2bf-bedf-4688-ac0a-77a2a50f33d7] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:12:35.757747 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-90c488d6-71f3-4ca1-9ba6-0b7e6fe0c540 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:35.758599 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-90c488d6-71f3-4ca1-9ba6-0b7e6fe0c540 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:35.759262 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-90c488d6-71f3-4ca1-9ba6-0b7e6fe0c540 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:35.760163 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-90c488d6-71f3-4ca1-9ba6-0b7e6fe0c540 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:35.760833 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-90c488d6-71f3-4ca1-9ba6-0b7e6fe0c540 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:35.761485 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-90c488d6-71f3-4ca1-9ba6-0b7e6fe0c540 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:35.940034 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-90c488d6-71f3-4ca1-9ba6-0b7e6fe0c540 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:35.941987 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-3fba604e-bfb4-485f-9d52-ec8f418ab945 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c786544e8fb4e8e8c3a4990a0f36725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618cf0b3507845909bb27c13460d1d6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:35.953723 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-3fba604e-bfb4-485f-9d52-ec8f418ab945 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] 10.222.0.27 "GET /compute/v2.1/servers/4fc83673-1557-4eb9-b80b-825364198d8a" status: 200 len: 1367 microversion: 2.1 time: 0.252348 Oct 17 03:12:35.955096 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-90c488d6-71f3-4ca1-9ba6-0b7e6fe0c540 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:35.955339 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 70/132] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:12:35 2022] GET /compute/v2.1/servers/4fc83673-1557-4eb9-b80b-825364198d8a => generated 1367 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:12:35.959410 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-90c488d6-71f3-4ca1-9ba6-0b7e6fe0c540 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:35.961386 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-90c488d6-71f3-4ca1-9ba6-0b7e6fe0c540 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7" status: 200 len: 1407 microversion: 2.20 time: 0.216778 Oct 17 03:12:35.971804 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 63/133] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 03:12:35 2022] GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7 => generated 1407 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:12:36.049544 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [req-3c89e3d3-2d9e-4ad1-b663-87b0335f4103 req-beabeb8b-6e6a-4164-8246-e3446e8711a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "603ee2bf-bedf-4688-ac0a-77a2a50f33d7", "name": "network-vif-plugged", "status": "completed", "tag": "faf2315a-88ad-4367-997b-65c1cf0209ee"}]} {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:12:36.062251 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [req-3c89e3d3-2d9e-4ad1-b663-87b0335f4103 req-beabeb8b-6e6a-4164-8246-e3446e8711a0 service nova] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:36.063075 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [req-3c89e3d3-2d9e-4ad1-b663-87b0335f4103 req-beabeb8b-6e6a-4164-8246-e3446e8711a0 service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:36.063528 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [req-3c89e3d3-2d9e-4ad1-b663-87b0335f4103 req-beabeb8b-6e6a-4164-8246-e3446e8711a0 service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:36.076442 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.compute.server_external_events [req-3c89e3d3-2d9e-4ad1-b663-87b0335f4103 req-beabeb8b-6e6a-4164-8246-e3446e8711a0 service nova] Creating event network-vif-plugged:faf2315a-88ad-4367-997b-65c1cf0209ee for instance 603ee2bf-bedf-4688-ac0a-77a2a50f33d7 on hv-cinder-84697 Oct 17 03:12:36.082630 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [req-3c89e3d3-2d9e-4ad1-b663-87b0335f4103 req-beabeb8b-6e6a-4164-8246-e3446e8711a0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125364 Oct 17 03:12:36.083953 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 71/134] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 03:12:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:12:36.091165 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-29bb3928-11c2-4f4f-bac9-53a8728d8603 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:12:36.092577 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-29bb3928-11c2-4f4f-bac9-53a8728d8603 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] [instance: f4241d22-757d-4baa-bee5-476e3fab96a8] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:12:36.100524 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-29bb3928-11c2-4f4f-bac9-53a8728d8603 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:36.101240 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-29bb3928-11c2-4f4f-bac9-53a8728d8603 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:36.103008 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-29bb3928-11c2-4f4f-bac9-53a8728d8603 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:36.104424 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-29bb3928-11c2-4f4f-bac9-53a8728d8603 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:36.105392 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-29bb3928-11c2-4f4f-bac9-53a8728d8603 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:36.106213 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-29bb3928-11c2-4f4f-bac9-53a8728d8603 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:36.189774 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-5fe1e362-1a6d-4303-915b-86ee915b2462 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:12:36.190626 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-5fe1e362-1a6d-4303-915b-86ee915b2462 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] [instance: 7b220b35-d9ac-48e4-b898-3d4f6c7be835] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:12:36.203054 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-5fe1e362-1a6d-4303-915b-86ee915b2462 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:36.204883 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-5fe1e362-1a6d-4303-915b-86ee915b2462 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:36.206364 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-5fe1e362-1a6d-4303-915b-86ee915b2462 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:36.208090 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-5fe1e362-1a6d-4303-915b-86ee915b2462 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:36.208612 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-5fe1e362-1a6d-4303-915b-86ee915b2462 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:36.213031 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-5fe1e362-1a6d-4303-915b-86ee915b2462 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:36.324579 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-29bb3928-11c2-4f4f-bac9-53a8728d8603 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4443729a5a5341b6ad64f6fa131a5a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd03f03d21e9e42fb91606306241a3fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:36.332721 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-29bb3928-11c2-4f4f-bac9-53a8728d8603 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] 10.222.0.27 "GET /compute/v2.1/servers/f4241d22-757d-4baa-bee5-476e3fab96a8" status: 200 len: 1315 microversion: 2.1 time: 0.246733 Oct 17 03:12:36.344006 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 64/135] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:12:36 2022] GET /compute/v2.1/servers/f4241d22-757d-4baa-bee5-476e3fab96a8 => generated 1315 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:12:36.426341 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-5d32e22b-02f0-46a6-9664-f43d0d9a0fae tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:12:36.426920 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-5d32e22b-02f0-46a6-9664-f43d0d9a0fae tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: f430d340-f7ff-4805-bd00-69eeaf33250d] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:12:36.435017 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-5d32e22b-02f0-46a6-9664-f43d0d9a0fae tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:36.435666 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-5d32e22b-02f0-46a6-9664-f43d0d9a0fae tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:36.436447 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-5d32e22b-02f0-46a6-9664-f43d0d9a0fae tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:36.437309 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-5d32e22b-02f0-46a6-9664-f43d0d9a0fae tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:36.437756 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-5d32e22b-02f0-46a6-9664-f43d0d9a0fae tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:36.438332 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-5d32e22b-02f0-46a6-9664-f43d0d9a0fae tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:36.471496 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-5fe1e362-1a6d-4303-915b-86ee915b2462 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce25db99a7b14d0bbaca41fff80e3da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5bad80dc0d74119b2a9cd5c1935e8d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:36.475858 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG dbcounter [-] [118886] Writing DB stats nova_cell1:SELECT=100 {{(pid=118886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:12:36.486998 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-5fe1e362-1a6d-4303-915b-86ee915b2462 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] 10.222.0.27 "GET /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835" status: 200 len: 1363 microversion: 2.1 time: 0.304885 Oct 17 03:12:36.502567 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 72/136] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:12:36 2022] GET /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835 => generated 1363 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:12:36.594529 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-5d32e22b-02f0-46a6-9664-f43d0d9a0fae tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1787a9ef7c44e28076aaa80c0152fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee21a91b84794e80b208fe72b7f1e010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:36.603229 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-5d32e22b-02f0-46a6-9664-f43d0d9a0fae tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "GET /compute/v2.1/servers/f430d340-f7ff-4805-bd00-69eeaf33250d" status: 200 len: 1322 microversion: 2.1 time: 0.181012 Oct 17 03:12:36.603803 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 65/137] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:12:36 2022] GET /compute/v2.1/servers/f430d340-f7ff-4805-bd00-69eeaf33250d => generated 1322 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:12:36.978564 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-b2092e6c-9d38-4c45-a37e-1e08844f2bf3 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:12:36.979052 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-b2092e6c-9d38-4c45-a37e-1e08844f2bf3 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] [instance: 4fc83673-1557-4eb9-b80b-825364198d8a] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:12:36.984947 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-b2092e6c-9d38-4c45-a37e-1e08844f2bf3 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:36.985440 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-b2092e6c-9d38-4c45-a37e-1e08844f2bf3 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:36.985902 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-b2092e6c-9d38-4c45-a37e-1e08844f2bf3 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:36.986543 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-b2092e6c-9d38-4c45-a37e-1e08844f2bf3 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:36.987019 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-b2092e6c-9d38-4c45-a37e-1e08844f2bf3 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:36.987442 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-b2092e6c-9d38-4c45-a37e-1e08844f2bf3 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:37.000124 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-82e71c8f-9c25-4e14-a33b-40de723ca70b tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:12:37.001042 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-82e71c8f-9c25-4e14-a33b-40de723ca70b tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 603ee2bf-bedf-4688-ac0a-77a2a50f33d7] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:12:37.007452 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-82e71c8f-9c25-4e14-a33b-40de723ca70b tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:37.007936 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-82e71c8f-9c25-4e14-a33b-40de723ca70b tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:37.008367 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-82e71c8f-9c25-4e14-a33b-40de723ca70b tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:37.009141 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-82e71c8f-9c25-4e14-a33b-40de723ca70b tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:37.009624 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-82e71c8f-9c25-4e14-a33b-40de723ca70b tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:37.010450 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-82e71c8f-9c25-4e14-a33b-40de723ca70b tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:37.130332 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-b2092e6c-9d38-4c45-a37e-1e08844f2bf3 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c786544e8fb4e8e8c3a4990a0f36725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618cf0b3507845909bb27c13460d1d6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:37.139670 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-b2092e6c-9d38-4c45-a37e-1e08844f2bf3 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] 10.222.0.27 "GET /compute/v2.1/servers/4fc83673-1557-4eb9-b80b-825364198d8a" status: 200 len: 1367 microversion: 2.1 time: 0.166007 Oct 17 03:12:37.140399 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 73/138] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:12:36 2022] GET /compute/v2.1/servers/4fc83673-1557-4eb9-b80b-825364198d8a => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:12:37.159204 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-82e71c8f-9c25-4e14-a33b-40de723ca70b tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:37.167841 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-82e71c8f-9c25-4e14-a33b-40de723ca70b tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:37.169466 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-82e71c8f-9c25-4e14-a33b-40de723ca70b tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:37.170619 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-82e71c8f-9c25-4e14-a33b-40de723ca70b tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7" status: 200 len: 1407 microversion: 2.20 time: 0.176620 Oct 17 03:12:37.171211 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 66/139] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 03:12:36 2022] GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7 => generated 1407 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 03:12:37.366510 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-e17345cf-e8ce-4852-9195-63f5fef6bccc tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:12:37.367498 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-e17345cf-e8ce-4852-9195-63f5fef6bccc tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] [instance: f4241d22-757d-4baa-bee5-476e3fab96a8] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:12:37.377102 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-e17345cf-e8ce-4852-9195-63f5fef6bccc tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:37.377585 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-e17345cf-e8ce-4852-9195-63f5fef6bccc tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:37.378014 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-e17345cf-e8ce-4852-9195-63f5fef6bccc tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:37.378708 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-e17345cf-e8ce-4852-9195-63f5fef6bccc tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:37.379195 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-e17345cf-e8ce-4852-9195-63f5fef6bccc tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:37.379615 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-e17345cf-e8ce-4852-9195-63f5fef6bccc tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:37.511604 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-a87c171b-8e34-4edd-b217-ca2b46b7be3c tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:12:37.513265 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-a87c171b-8e34-4edd-b217-ca2b46b7be3c tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] [instance: 7b220b35-d9ac-48e4-b898-3d4f6c7be835] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:12:37.515433 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-e17345cf-e8ce-4852-9195-63f5fef6bccc tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4443729a5a5341b6ad64f6fa131a5a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd03f03d21e9e42fb91606306241a3fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:37.520095 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-a87c171b-8e34-4edd-b217-ca2b46b7be3c tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:37.520818 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-a87c171b-8e34-4edd-b217-ca2b46b7be3c tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:37.521337 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-a87c171b-8e34-4edd-b217-ca2b46b7be3c tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:37.522912 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-a87c171b-8e34-4edd-b217-ca2b46b7be3c tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:37.523446 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-a87c171b-8e34-4edd-b217-ca2b46b7be3c tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:37.523760 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-e17345cf-e8ce-4852-9195-63f5fef6bccc tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] 10.222.0.27 "GET /compute/v2.1/servers/f4241d22-757d-4baa-bee5-476e3fab96a8" status: 200 len: 1315 microversion: 2.1 time: 0.161649 Oct 17 03:12:37.524177 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-a87c171b-8e34-4edd-b217-ca2b46b7be3c tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:37.537583 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 74/140] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:12:37 2022] GET /compute/v2.1/servers/f4241d22-757d-4baa-bee5-476e3fab96a8 => generated 1315 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:12:37.632918 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-82fb0f36-9504-4e3f-ae10-3af427d09f2d tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:12:37.633521 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-82fb0f36-9504-4e3f-ae10-3af427d09f2d tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: f430d340-f7ff-4805-bd00-69eeaf33250d] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:12:37.639570 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-82fb0f36-9504-4e3f-ae10-3af427d09f2d tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:37.640048 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-82fb0f36-9504-4e3f-ae10-3af427d09f2d tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:37.640817 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-82fb0f36-9504-4e3f-ae10-3af427d09f2d tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:37.641155 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-82fb0f36-9504-4e3f-ae10-3af427d09f2d tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:37.641629 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-82fb0f36-9504-4e3f-ae10-3af427d09f2d tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:37.642041 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-82fb0f36-9504-4e3f-ae10-3af427d09f2d tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:37.667294 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-a87c171b-8e34-4edd-b217-ca2b46b7be3c tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce25db99a7b14d0bbaca41fff80e3da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5bad80dc0d74119b2a9cd5c1935e8d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:37.677292 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-a87c171b-8e34-4edd-b217-ca2b46b7be3c tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] 10.222.0.27 "GET /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835" status: 200 len: 1363 microversion: 2.1 time: 0.170505 Oct 17 03:12:37.678086 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 67/141] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:12:37 2022] GET /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835 => generated 1363 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:12:37.788971 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-82fb0f36-9504-4e3f-ae10-3af427d09f2d tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1787a9ef7c44e28076aaa80c0152fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee21a91b84794e80b208fe72b7f1e010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:37.796833 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-82fb0f36-9504-4e3f-ae10-3af427d09f2d tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "GET /compute/v2.1/servers/f430d340-f7ff-4805-bd00-69eeaf33250d" status: 200 len: 1322 microversion: 2.1 time: 0.168388 Oct 17 03:12:37.797398 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 75/142] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:12:37 2022] GET /compute/v2.1/servers/f430d340-f7ff-4805-bd00-69eeaf33250d => generated 1322 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:12:38.108074 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [req-5bbc0b99-7c68-4c56-8483-b3dff10bd736 req-8693b961-d599-4c8d-a421-e58035d8fbc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90f2768b-8259-439c-af06-7eff342615ee", "name": "network-vif-plugged", "status": "completed", "tag": "c31f984d-a48a-493a-8e53-83388b4caabf"}]} {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:12:38.117818 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [req-5bbc0b99-7c68-4c56-8483-b3dff10bd736 req-8693b961-d599-4c8d-a421-e58035d8fbc8 service nova] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:38.118287 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [req-5bbc0b99-7c68-4c56-8483-b3dff10bd736 req-8693b961-d599-4c8d-a421-e58035d8fbc8 service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:38.118716 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [req-5bbc0b99-7c68-4c56-8483-b3dff10bd736 req-8693b961-d599-4c8d-a421-e58035d8fbc8 service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:38.130055 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.compute.server_external_events [req-5bbc0b99-7c68-4c56-8483-b3dff10bd736 req-8693b961-d599-4c8d-a421-e58035d8fbc8 service nova] Creating event network-vif-plugged:c31f984d-a48a-493a-8e53-83388b4caabf for instance 90f2768b-8259-439c-af06-7eff342615ee on hv-cinder-84697 Oct 17 03:12:38.135816 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [req-5bbc0b99-7c68-4c56-8483-b3dff10bd736 req-8693b961-d599-4c8d-a421-e58035d8fbc8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031576 Oct 17 03:12:38.140199 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 68/143] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 03:12:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:12:38.164052 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-b78f818c-a3f3-453c-8d07-b7a6a3e28259 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:12:38.164653 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-b78f818c-a3f3-453c-8d07-b7a6a3e28259 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] [instance: 4fc83673-1557-4eb9-b80b-825364198d8a] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:12:38.170418 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-b78f818c-a3f3-453c-8d07-b7a6a3e28259 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:38.170916 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-b78f818c-a3f3-453c-8d07-b7a6a3e28259 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:38.171494 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-b78f818c-a3f3-453c-8d07-b7a6a3e28259 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:38.172328 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-b78f818c-a3f3-453c-8d07-b7a6a3e28259 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:38.172775 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-b78f818c-a3f3-453c-8d07-b7a6a3e28259 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:38.173185 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-b78f818c-a3f3-453c-8d07-b7a6a3e28259 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:38.200342 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-e2a91b28-03f9-4dda-9c60-6e242b818a7d tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:12:38.201490 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-e2a91b28-03f9-4dda-9c60-6e242b818a7d tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 603ee2bf-bedf-4688-ac0a-77a2a50f33d7] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:12:38.208940 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-e2a91b28-03f9-4dda-9c60-6e242b818a7d tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:38.210352 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-e2a91b28-03f9-4dda-9c60-6e242b818a7d tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:38.211029 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-e2a91b28-03f9-4dda-9c60-6e242b818a7d tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:38.211810 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-e2a91b28-03f9-4dda-9c60-6e242b818a7d tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:38.212582 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-e2a91b28-03f9-4dda-9c60-6e242b818a7d tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:38.213172 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-e2a91b28-03f9-4dda-9c60-6e242b818a7d tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:38.374890 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-b78f818c-a3f3-453c-8d07-b7a6a3e28259 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c786544e8fb4e8e8c3a4990a0f36725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618cf0b3507845909bb27c13460d1d6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:38.387938 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-b78f818c-a3f3-453c-8d07-b7a6a3e28259 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] 10.222.0.27 "GET /compute/v2.1/servers/4fc83673-1557-4eb9-b80b-825364198d8a" status: 200 len: 1367 microversion: 2.1 time: 0.226716 Oct 17 03:12:38.391999 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 76/144] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:12:38 2022] GET /compute/v2.1/servers/4fc83673-1557-4eb9-b80b-825364198d8a => generated 1367 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:12:38.406332 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-e2a91b28-03f9-4dda-9c60-6e242b818a7d tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:38.416440 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-e2a91b28-03f9-4dda-9c60-6e242b818a7d tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:38.418238 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-e2a91b28-03f9-4dda-9c60-6e242b818a7d tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:38.419430 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-e2a91b28-03f9-4dda-9c60-6e242b818a7d tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7" status: 200 len: 1407 microversion: 2.20 time: 0.225753 Oct 17 03:12:38.420325 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 69/145] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 03:12:38 2022] GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7 => generated 1407 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 03:12:38.550735 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-90fb33a1-5558-4f60-8fbb-99f04252f894 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:12:38.552261 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-90fb33a1-5558-4f60-8fbb-99f04252f894 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] [instance: f4241d22-757d-4baa-bee5-476e3fab96a8] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:12:38.581048 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-90fb33a1-5558-4f60-8fbb-99f04252f894 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:38.583017 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-90fb33a1-5558-4f60-8fbb-99f04252f894 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:38.583691 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-90fb33a1-5558-4f60-8fbb-99f04252f894 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:38.586206 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-90fb33a1-5558-4f60-8fbb-99f04252f894 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:38.588467 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-90fb33a1-5558-4f60-8fbb-99f04252f894 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:38.589292 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-90fb33a1-5558-4f60-8fbb-99f04252f894 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:38.702421 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-ce09cd0c-87ae-420b-8862-b5827925349e tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:12:38.704865 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-ce09cd0c-87ae-420b-8862-b5827925349e tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] [instance: 7b220b35-d9ac-48e4-b898-3d4f6c7be835] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:12:38.723635 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-ce09cd0c-87ae-420b-8862-b5827925349e tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:38.730292 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-ce09cd0c-87ae-420b-8862-b5827925349e tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:38.732990 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-ce09cd0c-87ae-420b-8862-b5827925349e tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:38.733890 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-ce09cd0c-87ae-420b-8862-b5827925349e tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:38.734574 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-ce09cd0c-87ae-420b-8862-b5827925349e tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:38.737013 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-ce09cd0c-87ae-420b-8862-b5827925349e tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:39.087805 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-90fb33a1-5558-4f60-8fbb-99f04252f894 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4443729a5a5341b6ad64f6fa131a5a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd03f03d21e9e42fb91606306241a3fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:39.109724 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-90fb33a1-5558-4f60-8fbb-99f04252f894 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] 10.222.0.27 "GET /compute/v2.1/servers/f4241d22-757d-4baa-bee5-476e3fab96a8" status: 200 len: 1315 microversion: 2.1 time: 0.566540 Oct 17 03:12:39.110574 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 77/146] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:12:38 2022] GET /compute/v2.1/servers/f4241d22-757d-4baa-bee5-476e3fab96a8 => generated 1315 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:12:39.116921 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-a99be8a8-1d94-4ee8-ad48-7f781c1afbae tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:12:39.117744 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-a99be8a8-1d94-4ee8-ad48-7f781c1afbae tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: f430d340-f7ff-4805-bd00-69eeaf33250d] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:12:39.124224 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-a99be8a8-1d94-4ee8-ad48-7f781c1afbae tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:39.125000 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-a99be8a8-1d94-4ee8-ad48-7f781c1afbae tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:39.125644 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-a99be8a8-1d94-4ee8-ad48-7f781c1afbae tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:39.126573 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-a99be8a8-1d94-4ee8-ad48-7f781c1afbae tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:39.127838 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-a99be8a8-1d94-4ee8-ad48-7f781c1afbae tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:39.128491 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-a99be8a8-1d94-4ee8-ad48-7f781c1afbae tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:39.386800 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-a99be8a8-1d94-4ee8-ad48-7f781c1afbae tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1787a9ef7c44e28076aaa80c0152fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee21a91b84794e80b208fe72b7f1e010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:39.397681 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-a99be8a8-1d94-4ee8-ad48-7f781c1afbae tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "GET /compute/v2.1/servers/f430d340-f7ff-4805-bd00-69eeaf33250d" status: 200 len: 1322 microversion: 2.1 time: 0.285402 Oct 17 03:12:39.401324 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 78/147] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:12:39 2022] GET /compute/v2.1/servers/f430d340-f7ff-4805-bd00-69eeaf33250d => generated 1322 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:12:39.420642 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-e912f94d-c41d-4a90-8ae3-a0c25460b8de tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:12:39.422654 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-e912f94d-c41d-4a90-8ae3-a0c25460b8de tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] [instance: 4fc83673-1557-4eb9-b80b-825364198d8a] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:12:39.433315 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-e912f94d-c41d-4a90-8ae3-a0c25460b8de tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:39.434288 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-e912f94d-c41d-4a90-8ae3-a0c25460b8de tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:39.434983 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-e912f94d-c41d-4a90-8ae3-a0c25460b8de tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:39.436012 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-e912f94d-c41d-4a90-8ae3-a0c25460b8de tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:39.436715 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-e912f94d-c41d-4a90-8ae3-a0c25460b8de tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:39.437388 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-e912f94d-c41d-4a90-8ae3-a0c25460b8de tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:39.528928 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-ce09cd0c-87ae-420b-8862-b5827925349e tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce25db99a7b14d0bbaca41fff80e3da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5bad80dc0d74119b2a9cd5c1935e8d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:39.546282 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-ce09cd0c-87ae-420b-8862-b5827925349e tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] 10.222.0.27 "GET /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835" status: 200 len: 1363 microversion: 2.1 time: 0.848592 Oct 17 03:12:39.548057 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 70/148] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:12:38 2022] GET /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835 => generated 1363 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:12:39.575464 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-f89df6de-5b3c-472c-8010-80548c6b9338 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:12:39.578554 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-f89df6de-5b3c-472c-8010-80548c6b9338 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 603ee2bf-bedf-4688-ac0a-77a2a50f33d7] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:12:39.591405 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-f89df6de-5b3c-472c-8010-80548c6b9338 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:39.592977 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-f89df6de-5b3c-472c-8010-80548c6b9338 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:39.593590 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-f89df6de-5b3c-472c-8010-80548c6b9338 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:39.594784 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-f89df6de-5b3c-472c-8010-80548c6b9338 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:39.595899 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-f89df6de-5b3c-472c-8010-80548c6b9338 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:39.596743 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-f89df6de-5b3c-472c-8010-80548c6b9338 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:39.776548 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-e912f94d-c41d-4a90-8ae3-a0c25460b8de tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c786544e8fb4e8e8c3a4990a0f36725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618cf0b3507845909bb27c13460d1d6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:39.806472 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-e912f94d-c41d-4a90-8ae3-a0c25460b8de tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] 10.222.0.27 "GET /compute/v2.1/servers/4fc83673-1557-4eb9-b80b-825364198d8a" status: 200 len: 1367 microversion: 2.1 time: 0.393532 Oct 17 03:12:39.807336 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 79/149] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:12:39 2022] GET /compute/v2.1/servers/4fc83673-1557-4eb9-b80b-825364198d8a => generated 1367 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:12:39.862341 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-f89df6de-5b3c-472c-8010-80548c6b9338 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:39.873348 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-f89df6de-5b3c-472c-8010-80548c6b9338 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:39.875327 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-f89df6de-5b3c-472c-8010-80548c6b9338 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:39.879408 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-f89df6de-5b3c-472c-8010-80548c6b9338 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7" status: 200 len: 1407 microversion: 2.20 time: 0.327457 Oct 17 03:12:39.880196 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 71/150] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 03:12:39 2022] GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7 => generated 1407 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:12:40.137544 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-13db8ca8-715f-4e3b-a2e7-14d2f32cd286 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:12:40.138827 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-13db8ca8-715f-4e3b-a2e7-14d2f32cd286 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] [instance: f4241d22-757d-4baa-bee5-476e3fab96a8] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:12:40.149900 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-13db8ca8-715f-4e3b-a2e7-14d2f32cd286 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:40.150397 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-13db8ca8-715f-4e3b-a2e7-14d2f32cd286 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:40.150845 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-13db8ca8-715f-4e3b-a2e7-14d2f32cd286 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:40.151578 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-13db8ca8-715f-4e3b-a2e7-14d2f32cd286 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:40.152292 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-13db8ca8-715f-4e3b-a2e7-14d2f32cd286 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:40.152717 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-13db8ca8-715f-4e3b-a2e7-14d2f32cd286 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:40.357946 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-13db8ca8-715f-4e3b-a2e7-14d2f32cd286 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4443729a5a5341b6ad64f6fa131a5a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd03f03d21e9e42fb91606306241a3fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:40.365722 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-13db8ca8-715f-4e3b-a2e7-14d2f32cd286 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] 10.222.0.27 "GET /compute/v2.1/servers/f4241d22-757d-4baa-bee5-476e3fab96a8" status: 200 len: 1315 microversion: 2.1 time: 0.232536 Oct 17 03:12:40.367650 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 80/151] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:12:40 2022] GET /compute/v2.1/servers/f4241d22-757d-4baa-bee5-476e3fab96a8 => generated 1315 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:12:40.425712 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-e1b4a846-ba7a-4086-b295-47bed98bcce2 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:12:40.426322 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-e1b4a846-ba7a-4086-b295-47bed98bcce2 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: f430d340-f7ff-4805-bd00-69eeaf33250d] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:12:40.432757 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-e1b4a846-ba7a-4086-b295-47bed98bcce2 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:40.433243 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-e1b4a846-ba7a-4086-b295-47bed98bcce2 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:40.433676 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-e1b4a846-ba7a-4086-b295-47bed98bcce2 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:40.434378 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-e1b4a846-ba7a-4086-b295-47bed98bcce2 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:40.434831 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-e1b4a846-ba7a-4086-b295-47bed98bcce2 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:40.435292 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-e1b4a846-ba7a-4086-b295-47bed98bcce2 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:40.540254 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [req-904663e0-c548-4de6-97c7-57a3f0babdcb req-45eb77ed-0d95-4ae8-8cdd-ed90e7d71bf6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4241d22-757d-4baa-bee5-476e3fab96a8", "name": "network-vif-plugged", "status": "completed", "tag": "824256fe-bd04-430c-90af-ea00257587d7"}]} {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:12:40.552631 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [req-904663e0-c548-4de6-97c7-57a3f0babdcb req-45eb77ed-0d95-4ae8-8cdd-ed90e7d71bf6 service nova] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:40.554268 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [req-904663e0-c548-4de6-97c7-57a3f0babdcb req-45eb77ed-0d95-4ae8-8cdd-ed90e7d71bf6 service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:40.555071 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [req-904663e0-c548-4de6-97c7-57a3f0babdcb req-45eb77ed-0d95-4ae8-8cdd-ed90e7d71bf6 service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:40.571015 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.compute.server_external_events [req-904663e0-c548-4de6-97c7-57a3f0babdcb req-45eb77ed-0d95-4ae8-8cdd-ed90e7d71bf6 service nova] Creating event network-vif-plugged:824256fe-bd04-430c-90af-ea00257587d7 for instance f4241d22-757d-4baa-bee5-476e3fab96a8 on hv-cinder-84697 Oct 17 03:12:40.576886 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [req-904663e0-c548-4de6-97c7-57a3f0babdcb req-45eb77ed-0d95-4ae8-8cdd-ed90e7d71bf6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041531 Oct 17 03:12:40.577631 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 81/152] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 03:12:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 03:12:40.582828 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-9eddeb8b-5b79-4542-b718-e01050b37d68 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:12:40.583527 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-9eddeb8b-5b79-4542-b718-e01050b37d68 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] [instance: 7b220b35-d9ac-48e4-b898-3d4f6c7be835] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:12:40.590388 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-9eddeb8b-5b79-4542-b718-e01050b37d68 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:40.591218 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-9eddeb8b-5b79-4542-b718-e01050b37d68 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:40.591320 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-9eddeb8b-5b79-4542-b718-e01050b37d68 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:40.591998 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-9eddeb8b-5b79-4542-b718-e01050b37d68 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:40.592448 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-9eddeb8b-5b79-4542-b718-e01050b37d68 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:40.592868 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-9eddeb8b-5b79-4542-b718-e01050b37d68 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:40.766620 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-e1b4a846-ba7a-4086-b295-47bed98bcce2 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1787a9ef7c44e28076aaa80c0152fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee21a91b84794e80b208fe72b7f1e010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:40.778063 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG dbcounter [-] [118887] Writing DB stats nova_cell1:SELECT=100 {{(pid=118887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:12:40.781913 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-e1b4a846-ba7a-4086-b295-47bed98bcce2 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "GET /compute/v2.1/servers/f430d340-f7ff-4805-bd00-69eeaf33250d" status: 200 len: 1322 microversion: 2.1 time: 0.359712 Oct 17 03:12:40.796347 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 72/153] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:12:40 2022] GET /compute/v2.1/servers/f430d340-f7ff-4805-bd00-69eeaf33250d => generated 1322 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:12:40.826218 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-9eddeb8b-5b79-4542-b718-e01050b37d68 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce25db99a7b14d0bbaca41fff80e3da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5bad80dc0d74119b2a9cd5c1935e8d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:40.840084 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-c12b37df-1c8c-4bd3-b50d-427470bf0e75 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:12:40.841830 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-c12b37df-1c8c-4bd3-b50d-427470bf0e75 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] [instance: 4fc83673-1557-4eb9-b80b-825364198d8a] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:12:40.841952 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-9eddeb8b-5b79-4542-b718-e01050b37d68 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] 10.222.0.27 "GET /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835" status: 200 len: 1363 microversion: 2.1 time: 0.262938 Oct 17 03:12:40.855510 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 82/154] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:12:40 2022] GET /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835 => generated 1363 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:12:40.864135 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-c12b37df-1c8c-4bd3-b50d-427470bf0e75 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:40.865570 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-c12b37df-1c8c-4bd3-b50d-427470bf0e75 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:40.866685 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-c12b37df-1c8c-4bd3-b50d-427470bf0e75 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:40.868412 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-c12b37df-1c8c-4bd3-b50d-427470bf0e75 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:40.870090 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-c12b37df-1c8c-4bd3-b50d-427470bf0e75 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:40.870488 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-c12b37df-1c8c-4bd3-b50d-427470bf0e75 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:40.905227 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-90c37b90-d85a-4163-965c-895c131ef337 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:12:40.906152 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-90c37b90-d85a-4163-965c-895c131ef337 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 603ee2bf-bedf-4688-ac0a-77a2a50f33d7] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:12:40.915079 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-90c37b90-d85a-4163-965c-895c131ef337 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:40.924204 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-90c37b90-d85a-4163-965c-895c131ef337 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:40.924644 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-90c37b90-d85a-4163-965c-895c131ef337 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:40.925374 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-90c37b90-d85a-4163-965c-895c131ef337 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:40.932213 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-90c37b90-d85a-4163-965c-895c131ef337 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:40.932716 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-90c37b90-d85a-4163-965c-895c131ef337 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:41.158510 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-c12b37df-1c8c-4bd3-b50d-427470bf0e75 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c786544e8fb4e8e8c3a4990a0f36725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618cf0b3507845909bb27c13460d1d6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:41.170613 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-c12b37df-1c8c-4bd3-b50d-427470bf0e75 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] 10.222.0.27 "GET /compute/v2.1/servers/4fc83673-1557-4eb9-b80b-825364198d8a" status: 200 len: 1367 microversion: 2.1 time: 0.336220 Oct 17 03:12:41.174150 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 73/155] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:12:40 2022] GET /compute/v2.1/servers/4fc83673-1557-4eb9-b80b-825364198d8a => generated 1367 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:12:41.395195 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-80b60387-201b-42e2-9b76-1891e1b71422 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:12:41.396533 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-80b60387-201b-42e2-9b76-1891e1b71422 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] [instance: f4241d22-757d-4baa-bee5-476e3fab96a8] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:12:41.416863 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG dbcounter [-] [118887] Writing DB stats nova_api:SELECT=100 {{(pid=118887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:12:41.424542 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-80b60387-201b-42e2-9b76-1891e1b71422 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:41.426332 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-80b60387-201b-42e2-9b76-1891e1b71422 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:41.433840 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-80b60387-201b-42e2-9b76-1891e1b71422 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:41.434841 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-80b60387-201b-42e2-9b76-1891e1b71422 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:41.435444 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-80b60387-201b-42e2-9b76-1891e1b71422 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:41.436114 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-80b60387-201b-42e2-9b76-1891e1b71422 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:41.503599 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-90c37b90-d85a-4163-965c-895c131ef337 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:41.512508 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-90c37b90-d85a-4163-965c-895c131ef337 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:41.513943 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-90c37b90-d85a-4163-965c-895c131ef337 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:41.515086 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-90c37b90-d85a-4163-965c-895c131ef337 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7" status: 200 len: 1407 microversion: 2.20 time: 0.614589 Oct 17 03:12:41.515827 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 83/156] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 03:12:40 2022] GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7 => generated 1407 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:12:41.759141 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-80b60387-201b-42e2-9b76-1891e1b71422 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4443729a5a5341b6ad64f6fa131a5a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd03f03d21e9e42fb91606306241a3fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:41.768057 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-80b60387-201b-42e2-9b76-1891e1b71422 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] 10.222.0.27 "GET /compute/v2.1/servers/f4241d22-757d-4baa-bee5-476e3fab96a8" status: 200 len: 1315 microversion: 2.1 time: 0.377742 Oct 17 03:12:41.782890 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 74/157] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:12:41 2022] GET /compute/v2.1/servers/f4241d22-757d-4baa-bee5-476e3fab96a8 => generated 1315 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:12:41.810261 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-57778945-d43c-4532-96f7-21c14a650e51 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:12:41.811610 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-57778945-d43c-4532-96f7-21c14a650e51 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: f430d340-f7ff-4805-bd00-69eeaf33250d] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:12:41.822155 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-57778945-d43c-4532-96f7-21c14a650e51 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:41.823352 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-57778945-d43c-4532-96f7-21c14a650e51 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:41.827861 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-57778945-d43c-4532-96f7-21c14a650e51 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:41.832992 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-57778945-d43c-4532-96f7-21c14a650e51 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:41.833488 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-57778945-d43c-4532-96f7-21c14a650e51 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:41.833930 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-57778945-d43c-4532-96f7-21c14a650e51 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:41.868541 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-3e15e897-8bd5-4613-ab33-4c735d649a7c tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:12:41.876440 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-3e15e897-8bd5-4613-ab33-4c735d649a7c tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] [instance: 7b220b35-d9ac-48e4-b898-3d4f6c7be835] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:12:41.883754 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-3e15e897-8bd5-4613-ab33-4c735d649a7c tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:41.884453 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-3e15e897-8bd5-4613-ab33-4c735d649a7c tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:41.885516 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-3e15e897-8bd5-4613-ab33-4c735d649a7c tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:41.886394 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-3e15e897-8bd5-4613-ab33-4c735d649a7c tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:41.887582 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-3e15e897-8bd5-4613-ab33-4c735d649a7c tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:41.888162 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-3e15e897-8bd5-4613-ab33-4c735d649a7c tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:42.048468 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-57778945-d43c-4532-96f7-21c14a650e51 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1787a9ef7c44e28076aaa80c0152fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee21a91b84794e80b208fe72b7f1e010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:42.063265 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-57778945-d43c-4532-96f7-21c14a650e51 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "GET /compute/v2.1/servers/f430d340-f7ff-4805-bd00-69eeaf33250d" status: 200 len: 1322 microversion: 2.1 time: 0.259753 Oct 17 03:12:42.075206 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-3e15e897-8bd5-4613-ab33-4c735d649a7c tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce25db99a7b14d0bbaca41fff80e3da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5bad80dc0d74119b2a9cd5c1935e8d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:42.076054 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 84/158] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:12:41 2022] GET /compute/v2.1/servers/f430d340-f7ff-4805-bd00-69eeaf33250d => generated 1322 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:12:42.080343 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-3e15e897-8bd5-4613-ab33-4c735d649a7c tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] 10.222.0.27 "GET /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835" status: 200 len: 1363 microversion: 2.1 time: 0.216653 Oct 17 03:12:42.082160 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 75/159] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:12:41 2022] GET /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835 => generated 1363 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:12:42.198579 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-764ccd62-8531-454a-aec1-d7c3407a387c tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:12:42.199310 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-764ccd62-8531-454a-aec1-d7c3407a387c tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] [instance: 4fc83673-1557-4eb9-b80b-825364198d8a] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:12:42.206520 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-764ccd62-8531-454a-aec1-d7c3407a387c tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:42.207256 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-764ccd62-8531-454a-aec1-d7c3407a387c tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:42.207911 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-764ccd62-8531-454a-aec1-d7c3407a387c tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:42.208823 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-764ccd62-8531-454a-aec1-d7c3407a387c tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:42.209477 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-764ccd62-8531-454a-aec1-d7c3407a387c tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:42.210332 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-764ccd62-8531-454a-aec1-d7c3407a387c tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:42.416872 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-764ccd62-8531-454a-aec1-d7c3407a387c tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c786544e8fb4e8e8c3a4990a0f36725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618cf0b3507845909bb27c13460d1d6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:42.432042 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-764ccd62-8531-454a-aec1-d7c3407a387c tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] 10.222.0.27 "GET /compute/v2.1/servers/4fc83673-1557-4eb9-b80b-825364198d8a" status: 200 len: 1367 microversion: 2.1 time: 0.238246 Oct 17 03:12:42.444198 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 85/160] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:12:42 2022] GET /compute/v2.1/servers/4fc83673-1557-4eb9-b80b-825364198d8a => generated 1367 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:12:42.541873 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-c3a42211-1981-4b3b-91f9-299d858d856a tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:12:42.542720 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-c3a42211-1981-4b3b-91f9-299d858d856a tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 603ee2bf-bedf-4688-ac0a-77a2a50f33d7] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:12:42.550819 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-c3a42211-1981-4b3b-91f9-299d858d856a tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:42.552986 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-c3a42211-1981-4b3b-91f9-299d858d856a tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:42.568262 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-c3a42211-1981-4b3b-91f9-299d858d856a tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:42.570683 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-c3a42211-1981-4b3b-91f9-299d858d856a tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:42.572349 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-c3a42211-1981-4b3b-91f9-299d858d856a tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:42.573909 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-c3a42211-1981-4b3b-91f9-299d858d856a tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:42.625517 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [req-3e8eb13e-0251-4f10-8194-8bde9fc17c9c req-71f42fc3-616d-4a1b-8055-06b3a35d7efc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f430d340-f7ff-4805-bd00-69eeaf33250d", "name": "network-vif-plugged", "status": "completed", "tag": "5c656ce8-361e-4b32-8e55-8e2061a8f354"}, {"server_uuid": "7b220b35-d9ac-48e4-b898-3d4f6c7be835", "name": "network-vif-plugged", "status": "completed", "tag": "cf904496-4f8e-473c-8ea7-795ed5aefe57"}]} {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:12:42.635217 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG dbcounter [-] [118886] Writing DB stats nova_api:SELECT=100 {{(pid=118886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:12:42.657180 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [req-3e8eb13e-0251-4f10-8194-8bde9fc17c9c req-71f42fc3-616d-4a1b-8055-06b3a35d7efc service nova] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:42.667976 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [req-3e8eb13e-0251-4f10-8194-8bde9fc17c9c req-71f42fc3-616d-4a1b-8055-06b3a35d7efc service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:42.668809 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [req-3e8eb13e-0251-4f10-8194-8bde9fc17c9c req-71f42fc3-616d-4a1b-8055-06b3a35d7efc service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:42.714556 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.compute.server_external_events [req-3e8eb13e-0251-4f10-8194-8bde9fc17c9c req-71f42fc3-616d-4a1b-8055-06b3a35d7efc service nova] Creating event network-vif-plugged:5c656ce8-361e-4b32-8e55-8e2061a8f354 for instance f430d340-f7ff-4805-bd00-69eeaf33250d on hv-cinder-84697 Oct 17 03:12:42.715689 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.compute.server_external_events [req-3e8eb13e-0251-4f10-8194-8bde9fc17c9c req-71f42fc3-616d-4a1b-8055-06b3a35d7efc service nova] Creating event network-vif-plugged:cf904496-4f8e-473c-8ea7-795ed5aefe57 for instance 7b220b35-d9ac-48e4-b898-3d4f6c7be835 on hv-cinder-84697 Oct 17 03:12:42.731694 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [req-3e8eb13e-0251-4f10-8194-8bde9fc17c9c req-71f42fc3-616d-4a1b-8055-06b3a35d7efc service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.110008 Oct 17 03:12:42.732990 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 86/161] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 03:12:42 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:12:42.795073 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-0d62f8fd-3110-4ef3-b632-80443ec77542 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:12:42.795788 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-0d62f8fd-3110-4ef3-b632-80443ec77542 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] [instance: f4241d22-757d-4baa-bee5-476e3fab96a8] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:12:42.799297 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-c3a42211-1981-4b3b-91f9-299d858d856a tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:42.805562 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-0d62f8fd-3110-4ef3-b632-80443ec77542 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:42.806434 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-0d62f8fd-3110-4ef3-b632-80443ec77542 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:42.807289 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-0d62f8fd-3110-4ef3-b632-80443ec77542 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:42.808736 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-0d62f8fd-3110-4ef3-b632-80443ec77542 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:42.809402 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-0d62f8fd-3110-4ef3-b632-80443ec77542 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:42.810043 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-0d62f8fd-3110-4ef3-b632-80443ec77542 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:42.811383 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-c3a42211-1981-4b3b-91f9-299d858d856a tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:42.812964 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-c3a42211-1981-4b3b-91f9-299d858d856a tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:42.814148 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-c3a42211-1981-4b3b-91f9-299d858d856a tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7" status: 200 len: 1599 microversion: 2.20 time: 0.277038 Oct 17 03:12:42.819784 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 76/162] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 03:12:42 2022] GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7 => generated 1599 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:12:42.844825 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-28d90052-101b-45d3-b0e1-dac4afedfedb tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:12:42.845469 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-28d90052-101b-45d3-b0e1-dac4afedfedb tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 603ee2bf-bedf-4688-ac0a-77a2a50f33d7] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:12:42.853903 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-28d90052-101b-45d3-b0e1-dac4afedfedb tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:42.854790 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-28d90052-101b-45d3-b0e1-dac4afedfedb tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:42.855415 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-28d90052-101b-45d3-b0e1-dac4afedfedb tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:42.857004 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-28d90052-101b-45d3-b0e1-dac4afedfedb tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:42.858428 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-28d90052-101b-45d3-b0e1-dac4afedfedb tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:42.858836 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-28d90052-101b-45d3-b0e1-dac4afedfedb tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:43.048176 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-0d62f8fd-3110-4ef3-b632-80443ec77542 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4443729a5a5341b6ad64f6fa131a5a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd03f03d21e9e42fb91606306241a3fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:43.059393 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-28d90052-101b-45d3-b0e1-dac4afedfedb tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.219630 Oct 17 03:12:43.060626 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 77/163] 10.222.0.27 () {60 vars in 1316 bytes} [Mon Oct 17 03:12:42 2022] GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7/os-interface => generated 284 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 17 03:12:43.062239 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-0d62f8fd-3110-4ef3-b632-80443ec77542 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] 10.222.0.27 "GET /compute/v2.1/servers/f4241d22-757d-4baa-bee5-476e3fab96a8" status: 200 len: 1315 microversion: 2.1 time: 0.270242 Oct 17 03:12:43.064320 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 87/164] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:12:42 2022] GET /compute/v2.1/servers/f4241d22-757d-4baa-bee5-476e3fab96a8 => generated 1315 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:12:43.090669 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-0481e866-aaa7-48d7-a685-e04a296978d2 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:12:43.091593 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-0481e866-aaa7-48d7-a685-e04a296978d2 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: f430d340-f7ff-4805-bd00-69eeaf33250d] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:12:43.103094 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-0481e866-aaa7-48d7-a685-e04a296978d2 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:43.103799 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-0481e866-aaa7-48d7-a685-e04a296978d2 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:43.104622 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-0481e866-aaa7-48d7-a685-e04a296978d2 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:43.106026 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-0481e866-aaa7-48d7-a685-e04a296978d2 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:43.106443 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-60d3c657-b0cf-41ff-bb96-df5e9f839527 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:12:43.106985 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-0481e866-aaa7-48d7-a685-e04a296978d2 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:43.107221 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-60d3c657-b0cf-41ff-bb96-df5e9f839527 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] [instance: 7b220b35-d9ac-48e4-b898-3d4f6c7be835] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:12:43.108564 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-0481e866-aaa7-48d7-a685-e04a296978d2 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:43.130919 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-60d3c657-b0cf-41ff-bb96-df5e9f839527 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:43.131507 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-60d3c657-b0cf-41ff-bb96-df5e9f839527 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:43.131944 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-60d3c657-b0cf-41ff-bb96-df5e9f839527 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:43.132650 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-60d3c657-b0cf-41ff-bb96-df5e9f839527 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:43.133096 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-60d3c657-b0cf-41ff-bb96-df5e9f839527 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:43.133515 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-60d3c657-b0cf-41ff-bb96-df5e9f839527 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:43.358039 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-60d3c657-b0cf-41ff-bb96-df5e9f839527 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce25db99a7b14d0bbaca41fff80e3da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5bad80dc0d74119b2a9cd5c1935e8d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:43.369794 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-60d3c657-b0cf-41ff-bb96-df5e9f839527 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] 10.222.0.27 "GET /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835" status: 200 len: 1363 microversion: 2.1 time: 0.266826 Oct 17 03:12:43.371029 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 88/165] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:12:43 2022] GET /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835 => generated 1363 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:12:43.456806 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-3344ce2a-341b-4c3a-8edb-ebf507fbadeb tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:12:43.457934 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-3344ce2a-341b-4c3a-8edb-ebf507fbadeb tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] [instance: 4fc83673-1557-4eb9-b80b-825364198d8a] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:12:43.467632 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-3344ce2a-341b-4c3a-8edb-ebf507fbadeb tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:43.468918 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-3344ce2a-341b-4c3a-8edb-ebf507fbadeb tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:43.469980 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-3344ce2a-341b-4c3a-8edb-ebf507fbadeb tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:43.471133 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-3344ce2a-341b-4c3a-8edb-ebf507fbadeb tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:43.472321 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-3344ce2a-341b-4c3a-8edb-ebf507fbadeb tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:43.472965 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-3344ce2a-341b-4c3a-8edb-ebf507fbadeb tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:43.540441 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-0481e866-aaa7-48d7-a685-e04a296978d2 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1787a9ef7c44e28076aaa80c0152fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee21a91b84794e80b208fe72b7f1e010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:43.556207 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-0481e866-aaa7-48d7-a685-e04a296978d2 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "GET /compute/v2.1/servers/f430d340-f7ff-4805-bd00-69eeaf33250d" status: 200 len: 1322 microversion: 2.1 time: 0.467403 Oct 17 03:12:43.557495 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 78/166] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:12:43 2022] GET /compute/v2.1/servers/f430d340-f7ff-4805-bd00-69eeaf33250d => generated 1322 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:12:43.672567 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-3344ce2a-341b-4c3a-8edb-ebf507fbadeb tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c786544e8fb4e8e8c3a4990a0f36725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618cf0b3507845909bb27c13460d1d6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:43.684252 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-3344ce2a-341b-4c3a-8edb-ebf507fbadeb tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] 10.222.0.27 "GET /compute/v2.1/servers/4fc83673-1557-4eb9-b80b-825364198d8a" status: 200 len: 1367 microversion: 2.1 time: 0.230730 Oct 17 03:12:43.700191 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 89/167] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:12:43 2022] GET /compute/v2.1/servers/4fc83673-1557-4eb9-b80b-825364198d8a => generated 1367 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:12:44.088007 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-082c7312-ef48-49f7-944d-64efdcfa89c9 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:12:44.089432 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-082c7312-ef48-49f7-944d-64efdcfa89c9 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] [instance: f4241d22-757d-4baa-bee5-476e3fab96a8] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:12:44.095980 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-082c7312-ef48-49f7-944d-64efdcfa89c9 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:44.096776 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-082c7312-ef48-49f7-944d-64efdcfa89c9 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:44.097806 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-082c7312-ef48-49f7-944d-64efdcfa89c9 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:44.098750 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-082c7312-ef48-49f7-944d-64efdcfa89c9 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:44.099452 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-082c7312-ef48-49f7-944d-64efdcfa89c9 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:44.100627 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-082c7312-ef48-49f7-944d-64efdcfa89c9 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:44.395719 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-d95ee56c-ac38-4e54-9caf-837b9a69d067 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:12:44.398687 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-d95ee56c-ac38-4e54-9caf-837b9a69d067 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] [instance: 7b220b35-d9ac-48e4-b898-3d4f6c7be835] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:12:44.419875 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-d95ee56c-ac38-4e54-9caf-837b9a69d067 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:44.420386 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-d95ee56c-ac38-4e54-9caf-837b9a69d067 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:44.420852 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-d95ee56c-ac38-4e54-9caf-837b9a69d067 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:44.423123 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-d95ee56c-ac38-4e54-9caf-837b9a69d067 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:44.423712 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-d95ee56c-ac38-4e54-9caf-837b9a69d067 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:44.426737 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-d95ee56c-ac38-4e54-9caf-837b9a69d067 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:44.601419 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-d95ee56c-ac38-4e54-9caf-837b9a69d067 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce25db99a7b14d0bbaca41fff80e3da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5bad80dc0d74119b2a9cd5c1935e8d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:44.606498 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG dbcounter [-] [118886] Writing DB stats nova_cell1:SELECT=100 {{(pid=118886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:12:44.612724 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-d95ee56c-ac38-4e54-9caf-837b9a69d067 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] 10.222.0.27 "GET /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835" status: 200 len: 1363 microversion: 2.1 time: 0.222891 Oct 17 03:12:44.614057 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 90/168] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:12:44 2022] GET /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835 => generated 1363 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:12:44.634666 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-7bae763c-acb1-4929-b0e8-7456605da018 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:12:44.635706 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-7bae763c-acb1-4929-b0e8-7456605da018 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: f430d340-f7ff-4805-bd00-69eeaf33250d] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:12:44.647737 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-7bae763c-acb1-4929-b0e8-7456605da018 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:44.648635 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-7bae763c-acb1-4929-b0e8-7456605da018 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:44.649980 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-7bae763c-acb1-4929-b0e8-7456605da018 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:44.650460 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-7bae763c-acb1-4929-b0e8-7456605da018 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:44.650930 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-7bae763c-acb1-4929-b0e8-7456605da018 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:44.651693 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-7bae763c-acb1-4929-b0e8-7456605da018 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:44.708166 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-082c7312-ef48-49f7-944d-64efdcfa89c9 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4443729a5a5341b6ad64f6fa131a5a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd03f03d21e9e42fb91606306241a3fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:44.722526 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-082c7312-ef48-49f7-944d-64efdcfa89c9 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] 10.222.0.27 "GET /compute/v2.1/servers/f4241d22-757d-4baa-bee5-476e3fab96a8" status: 200 len: 1315 microversion: 2.1 time: 0.638735 Oct 17 03:12:44.723144 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 79/169] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:12:44 2022] GET /compute/v2.1/servers/f4241d22-757d-4baa-bee5-476e3fab96a8 => generated 1315 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:12:44.728476 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-05a80558-3feb-4cd4-9c8f-2ee96a39ee66 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:12:44.729089 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-05a80558-3feb-4cd4-9c8f-2ee96a39ee66 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] [instance: 4fc83673-1557-4eb9-b80b-825364198d8a] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:12:44.748798 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-05a80558-3feb-4cd4-9c8f-2ee96a39ee66 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:44.749540 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-05a80558-3feb-4cd4-9c8f-2ee96a39ee66 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:44.749999 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-05a80558-3feb-4cd4-9c8f-2ee96a39ee66 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:44.750776 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-05a80558-3feb-4cd4-9c8f-2ee96a39ee66 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:44.751612 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-05a80558-3feb-4cd4-9c8f-2ee96a39ee66 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:44.752264 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-05a80558-3feb-4cd4-9c8f-2ee96a39ee66 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:44.878354 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-7bae763c-acb1-4929-b0e8-7456605da018 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1787a9ef7c44e28076aaa80c0152fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee21a91b84794e80b208fe72b7f1e010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:44.889091 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-7bae763c-acb1-4929-b0e8-7456605da018 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "GET /compute/v2.1/servers/f430d340-f7ff-4805-bd00-69eeaf33250d" status: 200 len: 1322 microversion: 2.1 time: 0.273805 Oct 17 03:12:44.889856 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 91/170] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:12:44 2022] GET /compute/v2.1/servers/f430d340-f7ff-4805-bd00-69eeaf33250d => generated 1322 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:12:44.911236 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [req-1ed4c9de-2623-4d86-aad7-72a82fd37a94 req-62f2517e-c54b-4ac5-9f13-542e996440bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fc83673-1557-4eb9-b80b-825364198d8a", "name": "network-vif-plugged", "status": "completed", "tag": "4df765f6-05e9-4846-a92d-d12d217252a8"}]} {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:12:44.923638 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [req-1ed4c9de-2623-4d86-aad7-72a82fd37a94 req-62f2517e-c54b-4ac5-9f13-542e996440bd service nova] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:44.924241 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [req-1ed4c9de-2623-4d86-aad7-72a82fd37a94 req-62f2517e-c54b-4ac5-9f13-542e996440bd service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:44.924904 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [req-1ed4c9de-2623-4d86-aad7-72a82fd37a94 req-62f2517e-c54b-4ac5-9f13-542e996440bd service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:44.939127 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.compute.server_external_events [req-1ed4c9de-2623-4d86-aad7-72a82fd37a94 req-62f2517e-c54b-4ac5-9f13-542e996440bd service nova] Creating event network-vif-plugged:4df765f6-05e9-4846-a92d-d12d217252a8 for instance 4fc83673-1557-4eb9-b80b-825364198d8a on hv-cinder-84697 Oct 17 03:12:44.949813 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [req-1ed4c9de-2623-4d86-aad7-72a82fd37a94 req-62f2517e-c54b-4ac5-9f13-542e996440bd service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050360 Oct 17 03:12:44.951017 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 92/171] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 03:12:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:12:45.098384 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-05a80558-3feb-4cd4-9c8f-2ee96a39ee66 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c786544e8fb4e8e8c3a4990a0f36725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618cf0b3507845909bb27c13460d1d6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:45.128147 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-05a80558-3feb-4cd4-9c8f-2ee96a39ee66 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] 10.222.0.27 "GET /compute/v2.1/servers/4fc83673-1557-4eb9-b80b-825364198d8a" status: 200 len: 1367 microversion: 2.1 time: 0.399883 Oct 17 03:12:45.131522 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 80/172] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:12:44 2022] GET /compute/v2.1/servers/4fc83673-1557-4eb9-b80b-825364198d8a => generated 1367 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:12:45.465638 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [req-66d21f90-4773-4de9-8e16-27e4fdc07ffb req-653a8560-5164-44dc-83ce-72f67e79126c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "603ee2bf-bedf-4688-ac0a-77a2a50f33d7", "tag": "faf2315a-88ad-4367-997b-65c1cf0209ee"}]} {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:12:45.480403 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [req-66d21f90-4773-4de9-8e16-27e4fdc07ffb req-653a8560-5164-44dc-83ce-72f67e79126c service nova] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:45.481370 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [req-66d21f90-4773-4de9-8e16-27e4fdc07ffb req-653a8560-5164-44dc-83ce-72f67e79126c service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:45.482008 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [req-66d21f90-4773-4de9-8e16-27e4fdc07ffb req-653a8560-5164-44dc-83ce-72f67e79126c service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:45.497599 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.compute.server_external_events [req-66d21f90-4773-4de9-8e16-27e4fdc07ffb req-653a8560-5164-44dc-83ce-72f67e79126c service nova] Creating event network-changed:faf2315a-88ad-4367-997b-65c1cf0209ee for instance 603ee2bf-bedf-4688-ac0a-77a2a50f33d7 on hv-cinder-84697 Oct 17 03:12:45.511737 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [req-66d21f90-4773-4de9-8e16-27e4fdc07ffb req-653a8560-5164-44dc-83ce-72f67e79126c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052794 Oct 17 03:12:45.512914 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 93/173] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 03:12:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:12:45.642240 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-52a8effc-4459-49c9-af2b-ba39c36b4dce tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:12:45.642240 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-52a8effc-4459-49c9-af2b-ba39c36b4dce tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] [instance: 7b220b35-d9ac-48e4-b898-3d4f6c7be835] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:12:45.648864 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-52a8effc-4459-49c9-af2b-ba39c36b4dce tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:45.649355 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-52a8effc-4459-49c9-af2b-ba39c36b4dce tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:45.651220 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-52a8effc-4459-49c9-af2b-ba39c36b4dce tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:45.652267 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-52a8effc-4459-49c9-af2b-ba39c36b4dce tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:45.652827 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-52a8effc-4459-49c9-af2b-ba39c36b4dce tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:45.654464 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-52a8effc-4459-49c9-af2b-ba39c36b4dce tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:45.747768 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-3abb96a4-9dd9-476c-942c-ed9ce5675e5b tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:12:45.748461 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-3abb96a4-9dd9-476c-942c-ed9ce5675e5b tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] [instance: f4241d22-757d-4baa-bee5-476e3fab96a8] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:12:45.765668 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-3abb96a4-9dd9-476c-942c-ed9ce5675e5b tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:45.766616 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-3abb96a4-9dd9-476c-942c-ed9ce5675e5b tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:45.767211 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-3abb96a4-9dd9-476c-942c-ed9ce5675e5b tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:45.769754 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-3abb96a4-9dd9-476c-942c-ed9ce5675e5b tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:45.772946 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-3abb96a4-9dd9-476c-942c-ed9ce5675e5b tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:45.774178 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-3abb96a4-9dd9-476c-942c-ed9ce5675e5b tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:46.014399 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-52a8effc-4459-49c9-af2b-ba39c36b4dce tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce25db99a7b14d0bbaca41fff80e3da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5bad80dc0d74119b2a9cd5c1935e8d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:46.039314 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-52a8effc-4459-49c9-af2b-ba39c36b4dce tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] 10.222.0.27 "GET /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835" status: 200 len: 1363 microversion: 2.1 time: 0.404969 Oct 17 03:12:46.055399 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 81/174] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:12:45 2022] GET /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835 => generated 1363 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:12:46.063319 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-2ec51f7f-fc0c-4354-8081-10aad67b66db tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:12:46.064013 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-2ec51f7f-fc0c-4354-8081-10aad67b66db tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: f430d340-f7ff-4805-bd00-69eeaf33250d] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:12:46.070926 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-2ec51f7f-fc0c-4354-8081-10aad67b66db tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:46.071551 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-2ec51f7f-fc0c-4354-8081-10aad67b66db tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:46.072363 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-2ec51f7f-fc0c-4354-8081-10aad67b66db tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:46.073136 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-2ec51f7f-fc0c-4354-8081-10aad67b66db tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:46.073743 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-2ec51f7f-fc0c-4354-8081-10aad67b66db tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:46.074231 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-2ec51f7f-fc0c-4354-8081-10aad67b66db tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:46.085523 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-3abb96a4-9dd9-476c-942c-ed9ce5675e5b tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4443729a5a5341b6ad64f6fa131a5a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd03f03d21e9e42fb91606306241a3fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:46.096018 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-3abb96a4-9dd9-476c-942c-ed9ce5675e5b tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] 10.222.0.27 "GET /compute/v2.1/servers/f4241d22-757d-4baa-bee5-476e3fab96a8" status: 200 len: 1503 microversion: 2.1 time: 0.353188 Oct 17 03:12:46.099319 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 94/175] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:12:45 2022] GET /compute/v2.1/servers/f4241d22-757d-4baa-bee5-476e3fab96a8 => generated 1503 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:12:46.154531 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-024b9c57-ccfd-41ac-9e79-3e2b0a79a700 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:12:46.155322 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-024b9c57-ccfd-41ac-9e79-3e2b0a79a700 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] [instance: 4fc83673-1557-4eb9-b80b-825364198d8a] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:12:46.167300 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-024b9c57-ccfd-41ac-9e79-3e2b0a79a700 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:46.168351 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-024b9c57-ccfd-41ac-9e79-3e2b0a79a700 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:46.173770 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-024b9c57-ccfd-41ac-9e79-3e2b0a79a700 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:46.175161 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-024b9c57-ccfd-41ac-9e79-3e2b0a79a700 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:46.175771 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-024b9c57-ccfd-41ac-9e79-3e2b0a79a700 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:46.176354 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-024b9c57-ccfd-41ac-9e79-3e2b0a79a700 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:46.321430 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-2ec51f7f-fc0c-4354-8081-10aad67b66db tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1787a9ef7c44e28076aaa80c0152fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee21a91b84794e80b208fe72b7f1e010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:46.331727 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-2ec51f7f-fc0c-4354-8081-10aad67b66db tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "GET /compute/v2.1/servers/f430d340-f7ff-4805-bd00-69eeaf33250d" status: 200 len: 1322 microversion: 2.1 time: 0.272979 Oct 17 03:12:46.332313 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 82/176] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:12:46 2022] GET /compute/v2.1/servers/f430d340-f7ff-4805-bd00-69eeaf33250d => generated 1322 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:12:46.420771 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-024b9c57-ccfd-41ac-9e79-3e2b0a79a700 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c786544e8fb4e8e8c3a4990a0f36725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618cf0b3507845909bb27c13460d1d6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:46.430539 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-024b9c57-ccfd-41ac-9e79-3e2b0a79a700 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] 10.222.0.27 "GET /compute/v2.1/servers/4fc83673-1557-4eb9-b80b-825364198d8a" status: 200 len: 1367 microversion: 2.1 time: 0.282134 Oct 17 03:12:46.444802 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 95/177] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:12:46 2022] GET /compute/v2.1/servers/4fc83673-1557-4eb9-b80b-825364198d8a => generated 1367 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:12:47.066715 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-7021d230-f875-4633-b0a9-a6cebf1365b7 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:12:47.067342 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-7021d230-f875-4633-b0a9-a6cebf1365b7 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] [instance: 7b220b35-d9ac-48e4-b898-3d4f6c7be835] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:12:47.088523 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-7021d230-f875-4633-b0a9-a6cebf1365b7 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:47.089021 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-7021d230-f875-4633-b0a9-a6cebf1365b7 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:47.092393 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-7021d230-f875-4633-b0a9-a6cebf1365b7 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:47.093117 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-7021d230-f875-4633-b0a9-a6cebf1365b7 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:47.093572 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-7021d230-f875-4633-b0a9-a6cebf1365b7 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:47.093992 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-7021d230-f875-4633-b0a9-a6cebf1365b7 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:47.359866 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-cf6f9af8-e21c-4e57-b0ad-1296f91b48cc tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:12:47.361239 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-cf6f9af8-e21c-4e57-b0ad-1296f91b48cc tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: f430d340-f7ff-4805-bd00-69eeaf33250d] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:12:47.372327 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-cf6f9af8-e21c-4e57-b0ad-1296f91b48cc tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:47.372882 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-cf6f9af8-e21c-4e57-b0ad-1296f91b48cc tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:47.373467 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-cf6f9af8-e21c-4e57-b0ad-1296f91b48cc tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:47.374236 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-cf6f9af8-e21c-4e57-b0ad-1296f91b48cc tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:47.374828 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-cf6f9af8-e21c-4e57-b0ad-1296f91b48cc tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:47.375282 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-cf6f9af8-e21c-4e57-b0ad-1296f91b48cc tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:47.405624 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-7021d230-f875-4633-b0a9-a6cebf1365b7 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce25db99a7b14d0bbaca41fff80e3da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5bad80dc0d74119b2a9cd5c1935e8d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:47.414300 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-7021d230-f875-4633-b0a9-a6cebf1365b7 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] 10.222.0.27 "GET /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835" status: 200 len: 1550 microversion: 2.1 time: 0.352667 Oct 17 03:12:47.437358 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 83/178] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:12:47 2022] GET /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835 => generated 1550 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:12:47.443130 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-7b099fd7-05a9-4335-ab22-a1023371d5a7 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:12:47.443684 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-7b099fd7-05a9-4335-ab22-a1023371d5a7 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] [instance: 7b220b35-d9ac-48e4-b898-3d4f6c7be835] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:12:47.455141 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-7b099fd7-05a9-4335-ab22-a1023371d5a7 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:47.455995 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-7b099fd7-05a9-4335-ab22-a1023371d5a7 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:47.456746 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-7b099fd7-05a9-4335-ab22-a1023371d5a7 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:47.457658 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-7b099fd7-05a9-4335-ab22-a1023371d5a7 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:47.458278 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-7b099fd7-05a9-4335-ab22-a1023371d5a7 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:47.458841 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-7b099fd7-05a9-4335-ab22-a1023371d5a7 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:47.651091 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-cf6f9af8-e21c-4e57-b0ad-1296f91b48cc tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1787a9ef7c44e28076aaa80c0152fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee21a91b84794e80b208fe72b7f1e010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:47.664658 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-7b099fd7-05a9-4335-ab22-a1023371d5a7 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] 10.222.0.27 "GET /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.226116 Oct 17 03:12:47.665250 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 84/179] 10.222.0.27 () {58 vars in 1275 bytes} [Mon Oct 17 03:12:47 2022] GET /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835/os-interface => generated 285 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:12:47.673268 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-634ea3b6-12a0-4ec7-971f-cd5c1f43fc4d tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:12:47.673863 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-cf6f9af8-e21c-4e57-b0ad-1296f91b48cc tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "GET /compute/v2.1/servers/f430d340-f7ff-4805-bd00-69eeaf33250d" status: 200 len: 1516 microversion: 2.1 time: 0.310758 Oct 17 03:12:47.682976 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 96/180] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:12:47 2022] GET /compute/v2.1/servers/f430d340-f7ff-4805-bd00-69eeaf33250d => generated 1516 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:12:47.684131 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-634ea3b6-12a0-4ec7-971f-cd5c1f43fc4d tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] [instance: 4fc83673-1557-4eb9-b80b-825364198d8a] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:12:47.702101 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-634ea3b6-12a0-4ec7-971f-cd5c1f43fc4d tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:47.702593 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-634ea3b6-12a0-4ec7-971f-cd5c1f43fc4d tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:47.703064 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-634ea3b6-12a0-4ec7-971f-cd5c1f43fc4d tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:47.703768 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-634ea3b6-12a0-4ec7-971f-cd5c1f43fc4d tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:47.703916 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-6df7482f-ff03-4141-ab56-666110235d5b tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:12:47.704222 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-634ea3b6-12a0-4ec7-971f-cd5c1f43fc4d tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:47.704644 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-634ea3b6-12a0-4ec7-971f-cd5c1f43fc4d tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:47.706955 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-6df7482f-ff03-4141-ab56-666110235d5b tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: f430d340-f7ff-4805-bd00-69eeaf33250d] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:12:47.715617 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-6df7482f-ff03-4141-ab56-666110235d5b tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:47.716892 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-6df7482f-ff03-4141-ab56-666110235d5b tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:47.720450 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-6df7482f-ff03-4141-ab56-666110235d5b tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:47.723216 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-6df7482f-ff03-4141-ab56-666110235d5b tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:47.727643 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-6df7482f-ff03-4141-ab56-666110235d5b tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:47.728454 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-6df7482f-ff03-4141-ab56-666110235d5b tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:47.901310 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.objects.instance [None req-6df7482f-ff03-4141-ab56-666110235d5b tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lazy-loading 'flavor' on Instance uuid f430d340-f7ff-4805-bd00-69eeaf33250d {{(pid=118886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 03:12:48.097077 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-6df7482f-ff03-4141-ab56-666110235d5b tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "POST /compute/v2.1/servers/f430d340-f7ff-4805-bd00-69eeaf33250d/action" status: 200 len: 32 microversion: 2.1 time: 0.398562 Oct 17 03:12:48.098066 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 97/181] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 03:12:47 2022] POST /compute/v2.1/servers/f430d340-f7ff-4805-bd00-69eeaf33250d/action => generated 32 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 03:12:48.103975 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-d19f9e37-b734-4ebb-8dea-46cfd4548252 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dff9e0eb-b47a-4ee1-97b1-8ff54c5a177a"}} {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:12:48.106789 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-d19f9e37-b734-4ebb-8dea-46cfd4548252 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] [instance: f4241d22-757d-4baa-bee5-476e3fab96a8] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:12:48.113719 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-d19f9e37-b734-4ebb-8dea-46cfd4548252 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:48.114463 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-d19f9e37-b734-4ebb-8dea-46cfd4548252 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:48.114911 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-d19f9e37-b734-4ebb-8dea-46cfd4548252 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:48.116509 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-d19f9e37-b734-4ebb-8dea-46cfd4548252 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:48.117106 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-d19f9e37-b734-4ebb-8dea-46cfd4548252 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:48.117779 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-d19f9e37-b734-4ebb-8dea-46cfd4548252 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:48.219777 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-634ea3b6-12a0-4ec7-971f-cd5c1f43fc4d tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c786544e8fb4e8e8c3a4990a0f36725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618cf0b3507845909bb27c13460d1d6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:48.229626 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-634ea3b6-12a0-4ec7-971f-cd5c1f43fc4d tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] 10.222.0.27 "GET /compute/v2.1/servers/4fc83673-1557-4eb9-b80b-825364198d8a" status: 200 len: 1367 microversion: 2.1 time: 0.562694 Oct 17 03:12:48.230362 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 85/182] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:12:47 2022] GET /compute/v2.1/servers/4fc83673-1557-4eb9-b80b-825364198d8a => generated 1367 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:12:48.244951 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-a9e377a7-cbff-49c5-b118-2d5144537d10 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:12:48.244951 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-a9e377a7-cbff-49c5-b118-2d5144537d10 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: f430d340-f7ff-4805-bd00-69eeaf33250d] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:12:48.248889 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-a9e377a7-cbff-49c5-b118-2d5144537d10 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:48.249658 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-a9e377a7-cbff-49c5-b118-2d5144537d10 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:48.250313 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-a9e377a7-cbff-49c5-b118-2d5144537d10 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:48.251258 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-a9e377a7-cbff-49c5-b118-2d5144537d10 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:48.252276 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-a9e377a7-cbff-49c5-b118-2d5144537d10 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:48.252976 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-a9e377a7-cbff-49c5-b118-2d5144537d10 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:48.756349 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-d19f9e37-b734-4ebb-8dea-46cfd4548252 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] 10.222.0.27 "POST /compute/v2.1/servers/f4241d22-757d-4baa-bee5-476e3fab96a8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.656773 Oct 17 03:12:48.765342 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 98/183] 10.222.0.27 () {60 vars in 1323 bytes} [Mon Oct 17 03:12:48 2022] POST /compute/v2.1/servers/f4241d22-757d-4baa-bee5-476e3fab96a8/os-volume_attachments => generated 194 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:12:49.132000 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-a9e377a7-cbff-49c5-b118-2d5144537d10 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1787a9ef7c44e28076aaa80c0152fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee21a91b84794e80b208fe72b7f1e010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:49.142682 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-a9e377a7-cbff-49c5-b118-2d5144537d10 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "GET /compute/v2.1/servers/f430d340-f7ff-4805-bd00-69eeaf33250d" status: 200 len: 1522 microversion: 2.1 time: 0.911024 Oct 17 03:12:49.143548 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 86/184] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:12:48 2022] GET /compute/v2.1/servers/f430d340-f7ff-4805-bd00-69eeaf33250d => generated 1522 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:12:49.261605 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-11e45c25-6bb6-4e5e-88de-bbdecc5c1100 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:12:49.263739 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-11e45c25-6bb6-4e5e-88de-bbdecc5c1100 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] [instance: 4fc83673-1557-4eb9-b80b-825364198d8a] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:12:49.271483 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-11e45c25-6bb6-4e5e-88de-bbdecc5c1100 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:49.272195 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-11e45c25-6bb6-4e5e-88de-bbdecc5c1100 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:49.272613 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-11e45c25-6bb6-4e5e-88de-bbdecc5c1100 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:49.273424 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-11e45c25-6bb6-4e5e-88de-bbdecc5c1100 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:49.273880 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-11e45c25-6bb6-4e5e-88de-bbdecc5c1100 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:49.274382 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-11e45c25-6bb6-4e5e-88de-bbdecc5c1100 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:49.457337 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-11e45c25-6bb6-4e5e-88de-bbdecc5c1100 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c786544e8fb4e8e8c3a4990a0f36725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618cf0b3507845909bb27c13460d1d6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:49.474952 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-11e45c25-6bb6-4e5e-88de-bbdecc5c1100 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] 10.222.0.27 "GET /compute/v2.1/servers/4fc83673-1557-4eb9-b80b-825364198d8a" status: 200 len: 1558 microversion: 2.1 time: 0.214520 Oct 17 03:12:49.478467 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 99/185] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:12:49 2022] GET /compute/v2.1/servers/4fc83673-1557-4eb9-b80b-825364198d8a => generated 1558 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:12:49.505895 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-d507e475-915f-4304-a31f-5a66b1adc1f8 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:12:49.507344 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-d507e475-915f-4304-a31f-5a66b1adc1f8 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] [instance: 4fc83673-1557-4eb9-b80b-825364198d8a] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:12:49.519378 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-d507e475-915f-4304-a31f-5a66b1adc1f8 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:49.520557 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-d507e475-915f-4304-a31f-5a66b1adc1f8 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:49.522118 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-d507e475-915f-4304-a31f-5a66b1adc1f8 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:49.523934 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-d507e475-915f-4304-a31f-5a66b1adc1f8 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:49.524255 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-d507e475-915f-4304-a31f-5a66b1adc1f8 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:49.527726 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-d507e475-915f-4304-a31f-5a66b1adc1f8 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:49.805852 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-d507e475-915f-4304-a31f-5a66b1adc1f8 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] 10.222.0.27 "GET /compute/v2.1/servers/4fc83673-1557-4eb9-b80b-825364198d8a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.303866 Oct 17 03:12:49.806963 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 87/186] 10.222.0.27 () {58 vars in 1275 bytes} [Mon Oct 17 03:12:49 2022] GET /compute/v2.1/servers/4fc83673-1557-4eb9-b80b-825364198d8a/os-interface => generated 285 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:12:50.168800 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-1ace7c3e-5fc7-4d97-8eeb-a1754c56e977 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:12:50.170299 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-1ace7c3e-5fc7-4d97-8eeb-a1754c56e977 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: f430d340-f7ff-4805-bd00-69eeaf33250d] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:12:50.186745 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-1ace7c3e-5fc7-4d97-8eeb-a1754c56e977 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:50.188787 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-1ace7c3e-5fc7-4d97-8eeb-a1754c56e977 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:50.189459 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-1ace7c3e-5fc7-4d97-8eeb-a1754c56e977 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:50.190574 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-1ace7c3e-5fc7-4d97-8eeb-a1754c56e977 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:50.191297 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-1ace7c3e-5fc7-4d97-8eeb-a1754c56e977 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:50.191947 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-1ace7c3e-5fc7-4d97-8eeb-a1754c56e977 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:50.446608 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [req-e33e853c-6c1d-4989-973c-a5128379d576 req-8a4d8419-66ed-44ba-9db1-2a7583ed82db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b220b35-d9ac-48e4-b898-3d4f6c7be835", "tag": "cf904496-4f8e-473c-8ea7-795ed5aefe57"}]} {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:12:50.462388 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [req-e33e853c-6c1d-4989-973c-a5128379d576 req-8a4d8419-66ed-44ba-9db1-2a7583ed82db service nova] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:50.462893 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [req-e33e853c-6c1d-4989-973c-a5128379d576 req-8a4d8419-66ed-44ba-9db1-2a7583ed82db service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:50.465270 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [req-e33e853c-6c1d-4989-973c-a5128379d576 req-8a4d8419-66ed-44ba-9db1-2a7583ed82db service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:50.484534 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.compute.server_external_events [req-e33e853c-6c1d-4989-973c-a5128379d576 req-8a4d8419-66ed-44ba-9db1-2a7583ed82db service nova] Creating event network-changed:cf904496-4f8e-473c-8ea7-795ed5aefe57 for instance 7b220b35-d9ac-48e4-b898-3d4f6c7be835 on hv-cinder-84697 Oct 17 03:12:50.493971 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [req-e33e853c-6c1d-4989-973c-a5128379d576 req-8a4d8419-66ed-44ba-9db1-2a7583ed82db service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050556 Oct 17 03:12:50.495190 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 88/187] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 03:12:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:12:50.675750 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-1ace7c3e-5fc7-4d97-8eeb-a1754c56e977 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1787a9ef7c44e28076aaa80c0152fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee21a91b84794e80b208fe72b7f1e010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:50.694579 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-1ace7c3e-5fc7-4d97-8eeb-a1754c56e977 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "GET /compute/v2.1/servers/f430d340-f7ff-4805-bd00-69eeaf33250d" status: 200 len: 1522 microversion: 2.1 time: 0.523427 Oct 17 03:12:50.695329 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 100/188] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:12:50 2022] GET /compute/v2.1/servers/f430d340-f7ff-4805-bd00-69eeaf33250d => generated 1522 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:12:51.723680 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-c9ad6cba-976f-4689-b791-3de1a13a3f75 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:12:51.724358 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-c9ad6cba-976f-4689-b791-3de1a13a3f75 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: f430d340-f7ff-4805-bd00-69eeaf33250d] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:12:51.737909 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-c9ad6cba-976f-4689-b791-3de1a13a3f75 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:51.741710 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-c9ad6cba-976f-4689-b791-3de1a13a3f75 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:51.743878 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-c9ad6cba-976f-4689-b791-3de1a13a3f75 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:51.747059 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-c9ad6cba-976f-4689-b791-3de1a13a3f75 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:51.749192 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-c9ad6cba-976f-4689-b791-3de1a13a3f75 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:51.749893 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-c9ad6cba-976f-4689-b791-3de1a13a3f75 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:51.949768 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [req-1d8fa890-2e3e-4258-b52a-4d356901a62e req-ce33828c-3b7e-49ef-b0ef-40906171cf97 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4fc83673-1557-4eb9-b80b-825364198d8a", "tag": "4df765f6-05e9-4846-a92d-d12d217252a8"}]} {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:12:51.972067 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [req-1d8fa890-2e3e-4258-b52a-4d356901a62e req-ce33828c-3b7e-49ef-b0ef-40906171cf97 service nova] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:51.973141 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [req-1d8fa890-2e3e-4258-b52a-4d356901a62e req-ce33828c-3b7e-49ef-b0ef-40906171cf97 service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:51.973585 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [req-1d8fa890-2e3e-4258-b52a-4d356901a62e req-ce33828c-3b7e-49ef-b0ef-40906171cf97 service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:51.993622 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.compute.server_external_events [req-1d8fa890-2e3e-4258-b52a-4d356901a62e req-ce33828c-3b7e-49ef-b0ef-40906171cf97 service nova] Creating event network-changed:4df765f6-05e9-4846-a92d-d12d217252a8 for instance 4fc83673-1557-4eb9-b80b-825364198d8a on hv-cinder-84697 Oct 17 03:12:52.003261 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [req-1d8fa890-2e3e-4258-b52a-4d356901a62e req-ce33828c-3b7e-49ef-b0ef-40906171cf97 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059721 Oct 17 03:12:52.006562 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 101/189] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 03:12:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 03:12:52.193009 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-c9ad6cba-976f-4689-b791-3de1a13a3f75 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1787a9ef7c44e28076aaa80c0152fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee21a91b84794e80b208fe72b7f1e010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:52.211643 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-c9ad6cba-976f-4689-b791-3de1a13a3f75 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "GET /compute/v2.1/servers/f430d340-f7ff-4805-bd00-69eeaf33250d" status: 200 len: 1522 microversion: 2.1 time: 0.491571 Oct 17 03:12:52.213266 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 89/190] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:12:51 2022] GET /compute/v2.1/servers/f430d340-f7ff-4805-bd00-69eeaf33250d => generated 1522 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:12:53.242767 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-bee8c41c-33e5-4242-8b2b-a7c6f77c029b tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:12:53.243893 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-bee8c41c-33e5-4242-8b2b-a7c6f77c029b tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: f430d340-f7ff-4805-bd00-69eeaf33250d] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:12:53.253329 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-bee8c41c-33e5-4242-8b2b-a7c6f77c029b tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:53.254328 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-bee8c41c-33e5-4242-8b2b-a7c6f77c029b tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:53.255159 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-bee8c41c-33e5-4242-8b2b-a7c6f77c029b tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:53.256130 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-bee8c41c-33e5-4242-8b2b-a7c6f77c029b tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:53.257861 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-bee8c41c-33e5-4242-8b2b-a7c6f77c029b tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:53.261477 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-bee8c41c-33e5-4242-8b2b-a7c6f77c029b tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:53.423644 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-bee8c41c-33e5-4242-8b2b-a7c6f77c029b tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1787a9ef7c44e28076aaa80c0152fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee21a91b84794e80b208fe72b7f1e010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:53.432675 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-bee8c41c-33e5-4242-8b2b-a7c6f77c029b tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "GET /compute/v2.1/servers/f430d340-f7ff-4805-bd00-69eeaf33250d" status: 200 len: 1522 microversion: 2.1 time: 0.194766 Oct 17 03:12:53.433913 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 102/191] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:12:53 2022] GET /compute/v2.1/servers/f430d340-f7ff-4805-bd00-69eeaf33250d => generated 1522 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:12:54.458096 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-b37fa1db-55ce-4d7f-a85e-f8783ebc8d98 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:12:54.458717 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-b37fa1db-55ce-4d7f-a85e-f8783ebc8d98 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: f430d340-f7ff-4805-bd00-69eeaf33250d] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:12:54.466358 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-b37fa1db-55ce-4d7f-a85e-f8783ebc8d98 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:54.466891 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-b37fa1db-55ce-4d7f-a85e-f8783ebc8d98 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:54.467466 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-b37fa1db-55ce-4d7f-a85e-f8783ebc8d98 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:54.468317 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-b37fa1db-55ce-4d7f-a85e-f8783ebc8d98 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:54.469169 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-b37fa1db-55ce-4d7f-a85e-f8783ebc8d98 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:54.469812 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-b37fa1db-55ce-4d7f-a85e-f8783ebc8d98 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:54.618656 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-b37fa1db-55ce-4d7f-a85e-f8783ebc8d98 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1787a9ef7c44e28076aaa80c0152fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee21a91b84794e80b208fe72b7f1e010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:54.626887 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-b37fa1db-55ce-4d7f-a85e-f8783ebc8d98 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "GET /compute/v2.1/servers/f430d340-f7ff-4805-bd00-69eeaf33250d" status: 200 len: 1522 microversion: 2.1 time: 0.173060 Oct 17 03:12:54.627542 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 90/192] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:12:54 2022] GET /compute/v2.1/servers/f430d340-f7ff-4805-bd00-69eeaf33250d => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:12:55.649714 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-eeafbf43-9579-48b6-bd58-b0c90a438105 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:12:55.650322 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-eeafbf43-9579-48b6-bd58-b0c90a438105 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: f430d340-f7ff-4805-bd00-69eeaf33250d] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:12:55.656998 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-eeafbf43-9579-48b6-bd58-b0c90a438105 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:55.657477 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-eeafbf43-9579-48b6-bd58-b0c90a438105 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:55.657906 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-eeafbf43-9579-48b6-bd58-b0c90a438105 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:55.658599 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-eeafbf43-9579-48b6-bd58-b0c90a438105 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:55.659078 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-eeafbf43-9579-48b6-bd58-b0c90a438105 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:55.659518 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-eeafbf43-9579-48b6-bd58-b0c90a438105 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:55.790162 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-eeafbf43-9579-48b6-bd58-b0c90a438105 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1787a9ef7c44e28076aaa80c0152fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee21a91b84794e80b208fe72b7f1e010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:55.799224 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-eeafbf43-9579-48b6-bd58-b0c90a438105 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "GET /compute/v2.1/servers/f430d340-f7ff-4805-bd00-69eeaf33250d" status: 200 len: 1522 microversion: 2.1 time: 0.153302 Oct 17 03:12:55.800103 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 103/193] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:12:55 2022] GET /compute/v2.1/servers/f430d340-f7ff-4805-bd00-69eeaf33250d => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:12:56.822021 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-5206a5c5-e990-4adf-97c9-64089f1a6bfd tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:12:56.822713 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-5206a5c5-e990-4adf-97c9-64089f1a6bfd tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: f430d340-f7ff-4805-bd00-69eeaf33250d] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:12:56.828710 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-5206a5c5-e990-4adf-97c9-64089f1a6bfd tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:56.829203 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-5206a5c5-e990-4adf-97c9-64089f1a6bfd tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:56.829613 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-5206a5c5-e990-4adf-97c9-64089f1a6bfd tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:56.830297 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-5206a5c5-e990-4adf-97c9-64089f1a6bfd tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:56.830776 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-5206a5c5-e990-4adf-97c9-64089f1a6bfd tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:56.831221 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-5206a5c5-e990-4adf-97c9-64089f1a6bfd tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:56.835885 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG dbcounter [-] [118887] Writing DB stats nova_cell1:SELECT=100 {{(pid=118887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:12:56.977234 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-5206a5c5-e990-4adf-97c9-64089f1a6bfd tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1787a9ef7c44e28076aaa80c0152fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee21a91b84794e80b208fe72b7f1e010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:56.985109 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-5206a5c5-e990-4adf-97c9-64089f1a6bfd tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "GET /compute/v2.1/servers/f430d340-f7ff-4805-bd00-69eeaf33250d" status: 200 len: 1522 microversion: 2.1 time: 0.167444 Oct 17 03:12:56.985578 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 91/194] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:12:56 2022] GET /compute/v2.1/servers/f430d340-f7ff-4805-bd00-69eeaf33250d => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:12:58.007870 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-64e49fe7-b237-472c-8acf-04e07bd9cfd2 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:12:58.008493 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-64e49fe7-b237-472c-8acf-04e07bd9cfd2 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: f430d340-f7ff-4805-bd00-69eeaf33250d] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:12:58.014852 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-64e49fe7-b237-472c-8acf-04e07bd9cfd2 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:58.015368 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-64e49fe7-b237-472c-8acf-04e07bd9cfd2 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:58.015798 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-64e49fe7-b237-472c-8acf-04e07bd9cfd2 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:58.016489 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-64e49fe7-b237-472c-8acf-04e07bd9cfd2 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:58.016939 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-64e49fe7-b237-472c-8acf-04e07bd9cfd2 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:58.017357 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-64e49fe7-b237-472c-8acf-04e07bd9cfd2 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:58.162704 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-64e49fe7-b237-472c-8acf-04e07bd9cfd2 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1787a9ef7c44e28076aaa80c0152fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee21a91b84794e80b208fe72b7f1e010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:58.170413 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-64e49fe7-b237-472c-8acf-04e07bd9cfd2 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "GET /compute/v2.1/servers/f430d340-f7ff-4805-bd00-69eeaf33250d" status: 200 len: 1522 microversion: 2.1 time: 0.166296 Oct 17 03:12:58.171007 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 104/195] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:12:58 2022] GET /compute/v2.1/servers/f430d340-f7ff-4805-bd00-69eeaf33250d => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:12:59.196376 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-ca5c76cb-8e65-40cc-8c36-a9397b021d69 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:12:59.197582 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-ca5c76cb-8e65-40cc-8c36-a9397b021d69 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: f430d340-f7ff-4805-bd00-69eeaf33250d] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:12:59.210601 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-ca5c76cb-8e65-40cc-8c36-a9397b021d69 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:59.212722 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-ca5c76cb-8e65-40cc-8c36-a9397b021d69 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:59.213227 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-ca5c76cb-8e65-40cc-8c36-a9397b021d69 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:59.213943 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-ca5c76cb-8e65-40cc-8c36-a9397b021d69 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:12:59.214396 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-ca5c76cb-8e65-40cc-8c36-a9397b021d69 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:12:59.214816 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-ca5c76cb-8e65-40cc-8c36-a9397b021d69 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:12:59.418079 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-ca5c76cb-8e65-40cc-8c36-a9397b021d69 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1787a9ef7c44e28076aaa80c0152fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee21a91b84794e80b208fe72b7f1e010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:12:59.427013 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-ca5c76cb-8e65-40cc-8c36-a9397b021d69 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "GET /compute/v2.1/servers/f430d340-f7ff-4805-bd00-69eeaf33250d" status: 200 len: 1522 microversion: 2.1 time: 0.236914 Oct 17 03:12:59.427724 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 92/196] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:12:59 2022] GET /compute/v2.1/servers/f430d340-f7ff-4805-bd00-69eeaf33250d => generated 1522 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:13:00.461327 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-ba9a5ee3-7b1a-420a-b0b8-0299a80d9e48 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:13:00.466073 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-ba9a5ee3-7b1a-420a-b0b8-0299a80d9e48 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: f430d340-f7ff-4805-bd00-69eeaf33250d] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:13:00.480212 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-ba9a5ee3-7b1a-420a-b0b8-0299a80d9e48 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:00.480816 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-ba9a5ee3-7b1a-420a-b0b8-0299a80d9e48 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:00.481243 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-ba9a5ee3-7b1a-420a-b0b8-0299a80d9e48 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:00.481956 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-ba9a5ee3-7b1a-420a-b0b8-0299a80d9e48 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:00.482412 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-ba9a5ee3-7b1a-420a-b0b8-0299a80d9e48 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:00.482836 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-ba9a5ee3-7b1a-420a-b0b8-0299a80d9e48 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:00.651253 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-ba9a5ee3-7b1a-420a-b0b8-0299a80d9e48 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1787a9ef7c44e28076aaa80c0152fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee21a91b84794e80b208fe72b7f1e010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:13:00.661943 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-ba9a5ee3-7b1a-420a-b0b8-0299a80d9e48 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "GET /compute/v2.1/servers/f430d340-f7ff-4805-bd00-69eeaf33250d" status: 200 len: 1522 microversion: 2.1 time: 0.214516 Oct 17 03:13:00.662996 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 105/197] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:13:00 2022] GET /compute/v2.1/servers/f430d340-f7ff-4805-bd00-69eeaf33250d => generated 1522 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:13:01.325967 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-727e6e8a-4589-40e5-981c-50aa16507946 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:13:01.326540 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-727e6e8a-4589-40e5-981c-50aa16507946 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] [instance: f4241d22-757d-4baa-bee5-476e3fab96a8] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:13:01.332874 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-727e6e8a-4589-40e5-981c-50aa16507946 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:01.333606 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-727e6e8a-4589-40e5-981c-50aa16507946 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:01.334104 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-727e6e8a-4589-40e5-981c-50aa16507946 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:01.334963 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-727e6e8a-4589-40e5-981c-50aa16507946 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:01.335564 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-727e6e8a-4589-40e5-981c-50aa16507946 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:01.336049 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-727e6e8a-4589-40e5-981c-50aa16507946 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:01.364241 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-727e6e8a-4589-40e5-981c-50aa16507946 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] [instance: f4241d22-757d-4baa-bee5-476e3fab96a8] Going to try to terminate instance {{(pid=118887) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 03:13:01.489524 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-727e6e8a-4589-40e5-981c-50aa16507946 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f4241d22-757d-4baa-bee5-476e3fab96a8" status: 204 len: 0 microversion: 2.1 time: 0.167319 Oct 17 03:13:01.494171 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 93/198] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 03:13:01 2022] DELETE /compute/v2.1/servers/f4241d22-757d-4baa-bee5-476e3fab96a8 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 03:13:01.498903 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-f9cc8b7f-8f21-4823-b179-c50420db4ee9 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:13:01.499937 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-f9cc8b7f-8f21-4823-b179-c50420db4ee9 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] [instance: f4241d22-757d-4baa-bee5-476e3fab96a8] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:13:01.508048 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-f9cc8b7f-8f21-4823-b179-c50420db4ee9 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:01.508814 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-f9cc8b7f-8f21-4823-b179-c50420db4ee9 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:01.509440 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-f9cc8b7f-8f21-4823-b179-c50420db4ee9 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:01.510354 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-f9cc8b7f-8f21-4823-b179-c50420db4ee9 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:01.510973 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-f9cc8b7f-8f21-4823-b179-c50420db4ee9 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:01.511585 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-f9cc8b7f-8f21-4823-b179-c50420db4ee9 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:01.516071 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG dbcounter [-] [118886] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=118886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:13:01.686857 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-cc0b76dc-2196-4966-8883-016404d51114 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:13:01.687818 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-cc0b76dc-2196-4966-8883-016404d51114 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: f430d340-f7ff-4805-bd00-69eeaf33250d] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:13:01.696051 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-f9cc8b7f-8f21-4823-b179-c50420db4ee9 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4443729a5a5341b6ad64f6fa131a5a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd03f03d21e9e42fb91606306241a3fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:13:01.699116 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-cc0b76dc-2196-4966-8883-016404d51114 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:01.699631 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-cc0b76dc-2196-4966-8883-016404d51114 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:01.704371 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-cc0b76dc-2196-4966-8883-016404d51114 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:01.704371 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-cc0b76dc-2196-4966-8883-016404d51114 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:01.704371 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-cc0b76dc-2196-4966-8883-016404d51114 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:01.704371 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-cc0b76dc-2196-4966-8883-016404d51114 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:01.712384 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-f9cc8b7f-8f21-4823-b179-c50420db4ee9 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] 10.222.0.27 "GET /compute/v2.1/servers/f4241d22-757d-4baa-bee5-476e3fab96a8" status: 200 len: 1555 microversion: 2.1 time: 0.217183 Oct 17 03:13:01.713184 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 106/199] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:13:01 2022] GET /compute/v2.1/servers/f4241d22-757d-4baa-bee5-476e3fab96a8 => generated 1555 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:13:01.909693 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-cc0b76dc-2196-4966-8883-016404d51114 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1787a9ef7c44e28076aaa80c0152fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee21a91b84794e80b208fe72b7f1e010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:13:01.918163 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-cc0b76dc-2196-4966-8883-016404d51114 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "GET /compute/v2.1/servers/f430d340-f7ff-4805-bd00-69eeaf33250d" status: 200 len: 1522 microversion: 2.1 time: 0.236237 Oct 17 03:13:01.919320 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 94/200] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:13:01 2022] GET /compute/v2.1/servers/f430d340-f7ff-4805-bd00-69eeaf33250d => generated 1522 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:13:02.741215 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-78ebed08-09bd-43fe-8e21-bad098a21fa4 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:13:02.741833 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-78ebed08-09bd-43fe-8e21-bad098a21fa4 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] [instance: f4241d22-757d-4baa-bee5-476e3fab96a8] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:13:02.749038 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-78ebed08-09bd-43fe-8e21-bad098a21fa4 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:02.749721 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-78ebed08-09bd-43fe-8e21-bad098a21fa4 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:02.750321 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-78ebed08-09bd-43fe-8e21-bad098a21fa4 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:02.751203 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-78ebed08-09bd-43fe-8e21-bad098a21fa4 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:02.752076 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-78ebed08-09bd-43fe-8e21-bad098a21fa4 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:02.752655 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-78ebed08-09bd-43fe-8e21-bad098a21fa4 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:02.929408 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-78ebed08-09bd-43fe-8e21-bad098a21fa4 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4443729a5a5341b6ad64f6fa131a5a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd03f03d21e9e42fb91606306241a3fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:13:02.941385 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-d265daf4-f457-47e7-b37c-4afae227325d tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:13:02.942028 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-d265daf4-f457-47e7-b37c-4afae227325d tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: f430d340-f7ff-4805-bd00-69eeaf33250d] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:13:02.942648 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-78ebed08-09bd-43fe-8e21-bad098a21fa4 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] 10.222.0.27 "GET /compute/v2.1/servers/f4241d22-757d-4baa-bee5-476e3fab96a8" status: 200 len: 1555 microversion: 2.1 time: 0.208578 Oct 17 03:13:02.947643 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 107/201] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:13:02 2022] GET /compute/v2.1/servers/f4241d22-757d-4baa-bee5-476e3fab96a8 => generated 1555 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:13:02.958548 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-d265daf4-f457-47e7-b37c-4afae227325d tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:02.959592 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-d265daf4-f457-47e7-b37c-4afae227325d tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:02.960340 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-d265daf4-f457-47e7-b37c-4afae227325d tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:02.961519 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-d265daf4-f457-47e7-b37c-4afae227325d tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:02.962220 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-d265daf4-f457-47e7-b37c-4afae227325d tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:02.963080 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-d265daf4-f457-47e7-b37c-4afae227325d tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:03.157039 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-d265daf4-f457-47e7-b37c-4afae227325d tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1787a9ef7c44e28076aaa80c0152fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee21a91b84794e80b208fe72b7f1e010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:13:03.166772 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-d265daf4-f457-47e7-b37c-4afae227325d tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "GET /compute/v2.1/servers/f430d340-f7ff-4805-bd00-69eeaf33250d" status: 200 len: 1522 microversion: 2.1 time: 0.228928 Oct 17 03:13:03.167949 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 95/202] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:13:02 2022] GET /compute/v2.1/servers/f430d340-f7ff-4805-bd00-69eeaf33250d => generated 1522 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:13:03.973519 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-b6882003-3094-4b2a-8479-ac102075c37c tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:13:03.974139 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-b6882003-3094-4b2a-8479-ac102075c37c tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] [instance: f4241d22-757d-4baa-bee5-476e3fab96a8] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:13:03.981028 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-b6882003-3094-4b2a-8479-ac102075c37c tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:03.981504 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-b6882003-3094-4b2a-8479-ac102075c37c tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:03.981928 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-b6882003-3094-4b2a-8479-ac102075c37c tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:03.982610 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-b6882003-3094-4b2a-8479-ac102075c37c tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:03.983083 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-b6882003-3094-4b2a-8479-ac102075c37c tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:03.983504 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-b6882003-3094-4b2a-8479-ac102075c37c tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:04.162058 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-b6882003-3094-4b2a-8479-ac102075c37c tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4443729a5a5341b6ad64f6fa131a5a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd03f03d21e9e42fb91606306241a3fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:13:04.172297 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-b6882003-3094-4b2a-8479-ac102075c37c tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] 10.222.0.27 "GET /compute/v2.1/servers/f4241d22-757d-4baa-bee5-476e3fab96a8" status: 200 len: 1555 microversion: 2.1 time: 0.202593 Oct 17 03:13:04.173929 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 108/203] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:13:03 2022] GET /compute/v2.1/servers/f4241d22-757d-4baa-bee5-476e3fab96a8 => generated 1555 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:13:04.191968 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-96a0e9c5-9caa-4f89-9bf8-c3ca0b81055c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:13:04.193157 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-96a0e9c5-9caa-4f89-9bf8-c3ca0b81055c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: f430d340-f7ff-4805-bd00-69eeaf33250d] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:13:04.200057 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-96a0e9c5-9caa-4f89-9bf8-c3ca0b81055c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:04.201138 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-96a0e9c5-9caa-4f89-9bf8-c3ca0b81055c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:04.201580 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-96a0e9c5-9caa-4f89-9bf8-c3ca0b81055c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:04.202278 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-96a0e9c5-9caa-4f89-9bf8-c3ca0b81055c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:04.202978 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-96a0e9c5-9caa-4f89-9bf8-c3ca0b81055c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:04.203558 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-96a0e9c5-9caa-4f89-9bf8-c3ca0b81055c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:04.217781 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-be86b044-13af-48bb-ac0f-1d85c03f54e6 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1366918433", "imageRef": "e6d41914-f1bc-4b72-9113-1a69b3d0d83b", "flavorRef": "452", "networks": [{"uuid": "facc8931-b1bd-467e-90f2-4b5fa4eb484d"}]}} {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:13:04.304917 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.network.neutron [None req-be86b044-13af-48bb-ac0f-1d85c03f54e6 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] validate_networks() for [('facc8931-b1bd-467e-90f2-4b5fa4eb484d', None, None, None, None, None)] {{(pid=118886) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 03:13:04.563879 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-96a0e9c5-9caa-4f89-9bf8-c3ca0b81055c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1787a9ef7c44e28076aaa80c0152fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee21a91b84794e80b208fe72b7f1e010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:13:04.586625 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-96a0e9c5-9caa-4f89-9bf8-c3ca0b81055c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "GET /compute/v2.1/servers/f430d340-f7ff-4805-bd00-69eeaf33250d" status: 200 len: 1522 microversion: 2.1 time: 0.399380 Oct 17 03:13:04.587316 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 96/204] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:13:04 2022] GET /compute/v2.1/servers/f430d340-f7ff-4805-bd00-69eeaf33250d => generated 1522 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:13:04.603382 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [req-4b9d5692-2090-4c21-9a1c-3ea0bc35135f req-9d81c72f-f776-40dc-976b-7255a2bc3e11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4241d22-757d-4baa-bee5-476e3fab96a8", "name": "network-vif-deleted", "tag": "824256fe-bd04-430c-90af-ea00257587d7"}]} {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:13:04.617211 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [req-4b9d5692-2090-4c21-9a1c-3ea0bc35135f req-9d81c72f-f776-40dc-976b-7255a2bc3e11 service nova] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:04.618608 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [req-4b9d5692-2090-4c21-9a1c-3ea0bc35135f req-9d81c72f-f776-40dc-976b-7255a2bc3e11 service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:04.619267 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [req-4b9d5692-2090-4c21-9a1c-3ea0bc35135f req-9d81c72f-f776-40dc-976b-7255a2bc3e11 service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:04.635956 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.compute.server_external_events [req-4b9d5692-2090-4c21-9a1c-3ea0bc35135f req-9d81c72f-f776-40dc-976b-7255a2bc3e11 service nova] Creating event network-vif-deleted:824256fe-bd04-430c-90af-ea00257587d7 for instance f4241d22-757d-4baa-bee5-476e3fab96a8 on hv-cinder-84697 Oct 17 03:13:04.652610 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [req-4b9d5692-2090-4c21-9a1c-3ea0bc35135f req-9d81c72f-f776-40dc-976b-7255a2bc3e11 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063779 Oct 17 03:13:04.653234 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 97/205] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 03:13:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:13:04.721694 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.virt.hardware [None req-be86b044-13af-48bb-ac0f-1d85c03f54e6 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Flavor limits 0:0:0 {{(pid=118886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 03:13:04.722159 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.virt.hardware [None req-be86b044-13af-48bb-ac0f-1d85c03f54e6 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Image limits 0:0:0 {{(pid=118886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 03:13:04.722697 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.virt.hardware [None req-be86b044-13af-48bb-ac0f-1d85c03f54e6 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Flavor pref 0:0:0 {{(pid=118886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 03:13:04.723137 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.virt.hardware [None req-be86b044-13af-48bb-ac0f-1d85c03f54e6 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Image pref 0:0:0 {{(pid=118886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 03:13:04.723552 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.virt.hardware [None req-be86b044-13af-48bb-ac0f-1d85c03f54e6 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 03:13:04.733159 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-be86b044-13af-48bb-ac0f-1d85c03f54e6 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:04.733676 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-be86b044-13af-48bb-ac0f-1d85c03f54e6 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:04.734160 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-be86b044-13af-48bb-ac0f-1d85c03f54e6 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:04.734950 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-be86b044-13af-48bb-ac0f-1d85c03f54e6 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:04.735481 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-be86b044-13af-48bb-ac0f-1d85c03f54e6 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:04.735921 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-be86b044-13af-48bb-ac0f-1d85c03f54e6 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:04.753196 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.quota [None req-be86b044-13af-48bb-ac0f-1d85c03f54e6 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Getting quotas for project b87c159313f74c77a95172124e82dc25. Resources: {'instances', 'cores', 'ram'} {{(pid=118886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 03:13:04.757235 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.quota [None req-be86b044-13af-48bb-ac0f-1d85c03f54e6 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Getting quotas for user c58fbb2d79954020aa1328ef6bf925e4 and project b87c159313f74c77a95172124e82dc25. Resources: {'instances', 'cores', 'ram'} {{(pid=118886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 03:13:04.768135 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-be86b044-13af-48bb-ac0f-1d85c03f54e6 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Going to run 1 instances... {{(pid=118886) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 03:13:04.770340 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-be86b044-13af-48bb-ac0f-1d85c03f54e6 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] [instance: c5bef4f0-63d6-4f68-aeec-a77348fd3921] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e6d41914-f1bc-4b72-9113-1a69b3d0d83b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 03:13:04.818911 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-be86b044-13af-48bb-ac0f-1d85c03f54e6 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.608110 Oct 17 03:13:04.827078 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 109/206] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 03:13:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 618 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 03:13:04.832092 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-531cb5ce-8605-4ae4-8d96-78a891a5a65f tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:13:04.832778 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-531cb5ce-8605-4ae4-8d96-78a891a5a65f tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] [instance: c5bef4f0-63d6-4f68-aeec-a77348fd3921] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:13:04.900040 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-531cb5ce-8605-4ae4-8d96-78a891a5a65f tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58fbb2d79954020aa1328ef6bf925e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b87c159313f74c77a95172124e82dc25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:13:04.907287 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-531cb5ce-8605-4ae4-8d96-78a891a5a65f tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] 10.222.0.27 "GET /compute/v2.1/servers/c5bef4f0-63d6-4f68-aeec-a77348fd3921" status: 200 len: 1214 microversion: 2.1 time: 0.079625 Oct 17 03:13:04.908168 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 98/207] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:13:04 2022] GET /compute/v2.1/servers/c5bef4f0-63d6-4f68-aeec-a77348fd3921 => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:13:05.199635 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-c0ebcfa1-6358-48b2-a147-b96f1477c9f9 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:13:05.200235 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-c0ebcfa1-6358-48b2-a147-b96f1477c9f9 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] [instance: f4241d22-757d-4baa-bee5-476e3fab96a8] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:13:05.210365 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-c0ebcfa1-6358-48b2-a147-b96f1477c9f9 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:05.211122 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-c0ebcfa1-6358-48b2-a147-b96f1477c9f9 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:05.211740 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-c0ebcfa1-6358-48b2-a147-b96f1477c9f9 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:05.213059 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-c0ebcfa1-6358-48b2-a147-b96f1477c9f9 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:05.213812 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-c0ebcfa1-6358-48b2-a147-b96f1477c9f9 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:05.214309 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-c0ebcfa1-6358-48b2-a147-b96f1477c9f9 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:05.294800 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-c0ebcfa1-6358-48b2-a147-b96f1477c9f9 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:05.295331 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-c0ebcfa1-6358-48b2-a147-b96f1477c9f9 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:05.295765 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-c0ebcfa1-6358-48b2-a147-b96f1477c9f9 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:05.296213 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.objects.instance [None req-c0ebcfa1-6358-48b2-a147-b96f1477c9f9 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Lazy-loading 'fault' on Instance uuid f4241d22-757d-4baa-bee5-476e3fab96a8 {{(pid=118886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 03:13:05.351575 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-c0ebcfa1-6358-48b2-a147-b96f1477c9f9 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4443729a5a5341b6ad64f6fa131a5a54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd03f03d21e9e42fb91606306241a3fb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:13:05.360301 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-c0ebcfa1-6358-48b2-a147-b96f1477c9f9 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] 10.222.0.27 "GET /compute/v2.1/servers/f4241d22-757d-4baa-bee5-476e3fab96a8" status: 200 len: 1351 microversion: 2.1 time: 0.164960 Oct 17 03:13:05.360882 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 110/208] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:13:05 2022] GET /compute/v2.1/servers/f4241d22-757d-4baa-bee5-476e3fab96a8 => generated 1351 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:13:05.612336 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-049fa69b-7ab5-427c-ac0c-63fb2a9fd376 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:13:05.613627 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-049fa69b-7ab5-427c-ac0c-63fb2a9fd376 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: f430d340-f7ff-4805-bd00-69eeaf33250d] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:13:05.621871 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-049fa69b-7ab5-427c-ac0c-63fb2a9fd376 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:05.622909 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-049fa69b-7ab5-427c-ac0c-63fb2a9fd376 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:05.622909 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-049fa69b-7ab5-427c-ac0c-63fb2a9fd376 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:05.624152 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-049fa69b-7ab5-427c-ac0c-63fb2a9fd376 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:05.624707 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-049fa69b-7ab5-427c-ac0c-63fb2a9fd376 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:05.625215 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-049fa69b-7ab5-427c-ac0c-63fb2a9fd376 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:05.792394 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-049fa69b-7ab5-427c-ac0c-63fb2a9fd376 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1787a9ef7c44e28076aaa80c0152fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee21a91b84794e80b208fe72b7f1e010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:13:05.800663 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-049fa69b-7ab5-427c-ac0c-63fb2a9fd376 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "GET /compute/v2.1/servers/f430d340-f7ff-4805-bd00-69eeaf33250d" status: 200 len: 1522 microversion: 2.1 time: 0.192047 Oct 17 03:13:05.801431 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 99/209] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:13:05 2022] GET /compute/v2.1/servers/f430d340-f7ff-4805-bd00-69eeaf33250d => generated 1522 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:13:05.932027 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-6eed111b-2ad4-47d4-ba54-73896d3b2aa9 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:13:05.932662 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-6eed111b-2ad4-47d4-ba54-73896d3b2aa9 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] [instance: c5bef4f0-63d6-4f68-aeec-a77348fd3921] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:13:05.938761 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-6eed111b-2ad4-47d4-ba54-73896d3b2aa9 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:05.939288 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-6eed111b-2ad4-47d4-ba54-73896d3b2aa9 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:05.939720 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-6eed111b-2ad4-47d4-ba54-73896d3b2aa9 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:05.940412 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-6eed111b-2ad4-47d4-ba54-73896d3b2aa9 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:05.940862 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-6eed111b-2ad4-47d4-ba54-73896d3b2aa9 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:05.941280 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-6eed111b-2ad4-47d4-ba54-73896d3b2aa9 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:06.028420 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-6eed111b-2ad4-47d4-ba54-73896d3b2aa9 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58fbb2d79954020aa1328ef6bf925e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b87c159313f74c77a95172124e82dc25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:13:06.036355 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-6eed111b-2ad4-47d4-ba54-73896d3b2aa9 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] 10.222.0.27 "GET /compute/v2.1/servers/c5bef4f0-63d6-4f68-aeec-a77348fd3921" status: 200 len: 1266 microversion: 2.1 time: 0.108761 Oct 17 03:13:06.038308 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 111/210] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:13:05 2022] GET /compute/v2.1/servers/c5bef4f0-63d6-4f68-aeec-a77348fd3921 => generated 1266 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:13:06.385415 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-94f51bb7-1817-46a8-8a45-1468cb2c4d6e tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:13:06.385958 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-94f51bb7-1817-46a8-8a45-1468cb2c4d6e tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] [instance: f4241d22-757d-4baa-bee5-476e3fab96a8] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:13:06.392266 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-94f51bb7-1817-46a8-8a45-1468cb2c4d6e tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:06.392804 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-94f51bb7-1817-46a8-8a45-1468cb2c4d6e tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:06.393394 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-94f51bb7-1817-46a8-8a45-1468cb2c4d6e tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:06.394199 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-94f51bb7-1817-46a8-8a45-1468cb2c4d6e tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:06.394654 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-94f51bb7-1817-46a8-8a45-1468cb2c4d6e tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:06.395230 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-94f51bb7-1817-46a8-8a45-1468cb2c4d6e tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:06.410092 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.wsgi [None req-94f51bb7-1817-46a8-8a45-1468cb2c4d6e tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] HTTP exception thrown: Instance f4241d22-757d-4baa-bee5-476e3fab96a8 could not be found. Oct 17 03:13:06.427457 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-94f51bb7-1817-46a8-8a45-1468cb2c4d6e tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Request method failure captured: Oct 17 03:13:06.427457 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: request: GET /compute/v2.1/servers/f4241d22-757d-4baa-bee5-476e3fab96a8 HTTP/1.1 Oct 17 03:13:06.427457 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Accept: application/json Oct 17 03:13:06.427457 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Accept-Encoding: identity Oct 17 03:13:06.427457 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Connection: close Oct 17 03:13:06.427457 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Content-Length: 0 Oct 17 03:13:06.427457 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Content-Type: application/json Oct 17 03:13:06.427457 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Host: 10.222.0.27 Oct 17 03:13:06.427457 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Openstack-System-Scope: None Oct 17 03:13:06.427457 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: User-Agent: python-urllib3/1.26.12 Oct 17 03:13:06.427457 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Auth-Token: gAAAAABjTMf-bC-ZNhy0wAe8-jyV6apHcx2OjnURQLZeYEzkG-TkxsYFgu2eJMSldcync4VenQsbqMkI7qShknoA7qyTKzIvgHbmnhJ_zq48PCOLW0Ar8x9J8onBmMzuqkcRsJCAuEbO9ldJS467JwkbZ1W2Dzc5KTbedcyCC9fCNa1BsHLTbtw Oct 17 03:13:06.427457 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Domain-Id: None Oct 17 03:13:06.427457 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Domain-Name: None Oct 17 03:13:06.427457 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Identity-Status: Confirmed Oct 17 03:13:06.427457 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Is-Admin-Project: True Oct 17 03:13:06.427457 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Project-Domain-Id: default Oct 17 03:13:06.427457 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Project-Domain-Name: Default Oct 17 03:13:06.427457 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Project-Id: d03f03d21e9e42fb91606306241a3fb7 Oct 17 03:13:06.427457 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Project-Name: tempest-DeleteServersTestJSON-1926001539 Oct 17 03:13:06.427457 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Role: member,reader Oct 17 03:13:06.427457 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Roles: member,reader Oct 17 03:13:06.429754 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d03f03d21e9e42fb91606306241a3fb7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d03f03d21e9e42fb91606306241a3fb7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d03f03d21e9e42fb91606306241a3fb7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d03f03d21e9e42fb91606306241a3fb7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 17 03:13:06.429754 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Tenant: tempest-DeleteServersTestJSON-1926001539 Oct 17 03:13:06.429754 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Tenant-Id: d03f03d21e9e42fb91606306241a3fb7 Oct 17 03:13:06.429754 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Tenant-Name: tempest-DeleteServersTestJSON-1926001539 Oct 17 03:13:06.429754 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-User: tempest-DeleteServersTestJSON-1926001539-project Oct 17 03:13:06.429754 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-User-Domain-Id: default Oct 17 03:13:06.429754 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-User-Domain-Name: Default Oct 17 03:13:06.429754 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-User-Id: 4443729a5a5341b6ad64f6fa131a5a54 Oct 17 03:13:06.429754 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-User-Name: tempest-DeleteServersTestJSON-1926001539-project Oct 17 03:13:06.429754 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: method: > Oct 17 03:13:06.429754 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: exception: Instance f4241d22-757d-4baa-bee5-476e3fab96a8 could not be found. Oct 17 03:13:06.429754 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: action_args: {'id': 'f4241d22-757d-4baa-bee5-476e3fab96a8'} Oct 17 03:13:06.430578 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 03:13:06.430578 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:13:06.430578 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 03:13:06.430578 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 03:13:06.430578 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 03:13:06.430578 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 03:13:06.430578 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 03:13:06.430578 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 03:13:06.430578 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 03:13:06.430578 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 03:13:06.430578 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4241d22-757d-4baa-bee5-476e3fab96a8 could not be found. Oct 17 03:13:06.430578 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Oct 17 03:13:06.430578 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:13:06.430578 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Oct 17 03:13:06.430578 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:13:06.430578 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:13:06.430578 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:13:06.430578 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 03:13:06.430578 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 03:13:06.430578 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 03:13:06.431872 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 03:13:06.431872 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 03:13:06.431872 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 03:13:06.431872 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 03:13:06.431872 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 03:13:06.431872 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 03:13:06.431872 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 03:13:06.431872 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4241d22-757d-4baa-bee5-476e3fab96a8 could not be found. Oct 17 03:13:06.431872 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Oct 17 03:13:06.431872 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:13:06.431872 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Oct 17 03:13:06.431872 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:13:06.431872 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:13:06.431872 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:13:06.431872 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 03:13:06.431872 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 03:13:06.431872 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4241d22-757d-4baa-bee5-476e3fab96a8 could not be found. Oct 17 03:13:06.431872 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Oct 17 03:13:06.433036 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-94f51bb7-1817-46a8-8a45-1468cb2c4d6e tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Returning 404 to user: Instance f4241d22-757d-4baa-bee5-476e3fab96a8 could not be found. {{(pid=118887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 03:13:06.433036 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-94f51bb7-1817-46a8-8a45-1468cb2c4d6e tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] 10.222.0.27 "GET /compute/v2.1/servers/f4241d22-757d-4baa-bee5-476e3fab96a8" status: 404 len: 111 microversion: 2.1 time: 0.049477 Oct 17 03:13:06.433036 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 100/211] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:13:06 2022] GET /compute/v2.1/servers/f4241d22-757d-4baa-bee5-476e3fab96a8 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 03:13:06.572215 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-00df60a3-833e-4e41-9e7d-42d2062e6097 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:13:06.575522 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-00df60a3-833e-4e41-9e7d-42d2062e6097 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] [instance: f4241d22-757d-4baa-bee5-476e3fab96a8] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:13:06.585701 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-00df60a3-833e-4e41-9e7d-42d2062e6097 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:06.586909 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-00df60a3-833e-4e41-9e7d-42d2062e6097 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:06.587739 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-00df60a3-833e-4e41-9e7d-42d2062e6097 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:06.589028 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-00df60a3-833e-4e41-9e7d-42d2062e6097 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:06.589804 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-00df60a3-833e-4e41-9e7d-42d2062e6097 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:06.590234 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-00df60a3-833e-4e41-9e7d-42d2062e6097 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:06.606111 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.wsgi [None req-00df60a3-833e-4e41-9e7d-42d2062e6097 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] HTTP exception thrown: Instance f4241d22-757d-4baa-bee5-476e3fab96a8 could not be found. Oct 17 03:13:06.616718 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-00df60a3-833e-4e41-9e7d-42d2062e6097 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Request method failure captured: Oct 17 03:13:06.616718 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: request: GET /compute/v2.1/servers/f4241d22-757d-4baa-bee5-476e3fab96a8/os-volume_attachments HTTP/1.1 Oct 17 03:13:06.616718 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Accept: application/json Oct 17 03:13:06.616718 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Accept-Encoding: identity Oct 17 03:13:06.616718 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Connection: close Oct 17 03:13:06.616718 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Content-Length: 0 Oct 17 03:13:06.616718 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Content-Type: application/json Oct 17 03:13:06.616718 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Host: 10.222.0.27 Oct 17 03:13:06.616718 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Openstack-System-Scope: None Oct 17 03:13:06.616718 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: User-Agent: python-urllib3/1.26.12 Oct 17 03:13:06.616718 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Auth-Token: gAAAAABjTMf-bC-ZNhy0wAe8-jyV6apHcx2OjnURQLZeYEzkG-TkxsYFgu2eJMSldcync4VenQsbqMkI7qShknoA7qyTKzIvgHbmnhJ_zq48PCOLW0Ar8x9J8onBmMzuqkcRsJCAuEbO9ldJS467JwkbZ1W2Dzc5KTbedcyCC9fCNa1BsHLTbtw Oct 17 03:13:06.616718 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Domain-Id: None Oct 17 03:13:06.616718 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Domain-Name: None Oct 17 03:13:06.616718 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Identity-Status: Confirmed Oct 17 03:13:06.616718 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Is-Admin-Project: True Oct 17 03:13:06.616718 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Project-Domain-Id: default Oct 17 03:13:06.616718 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Project-Domain-Name: Default Oct 17 03:13:06.616718 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Project-Id: d03f03d21e9e42fb91606306241a3fb7 Oct 17 03:13:06.616718 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Project-Name: tempest-DeleteServersTestJSON-1926001539 Oct 17 03:13:06.616718 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Role: member,reader Oct 17 03:13:06.616718 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Roles: member,reader Oct 17 03:13:06.617961 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d03f03d21e9e42fb91606306241a3fb7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d03f03d21e9e42fb91606306241a3fb7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d03f03d21e9e42fb91606306241a3fb7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d03f03d21e9e42fb91606306241a3fb7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 17 03:13:06.617961 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Tenant: tempest-DeleteServersTestJSON-1926001539 Oct 17 03:13:06.617961 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Tenant-Id: d03f03d21e9e42fb91606306241a3fb7 Oct 17 03:13:06.617961 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Tenant-Name: tempest-DeleteServersTestJSON-1926001539 Oct 17 03:13:06.617961 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-User: tempest-DeleteServersTestJSON-1926001539-project Oct 17 03:13:06.617961 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-User-Domain-Id: default Oct 17 03:13:06.617961 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-User-Domain-Name: Default Oct 17 03:13:06.617961 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-User-Id: 4443729a5a5341b6ad64f6fa131a5a54 Oct 17 03:13:06.617961 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-User-Name: tempest-DeleteServersTestJSON-1926001539-project Oct 17 03:13:06.617961 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: method: > Oct 17 03:13:06.617961 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: exception: Instance f4241d22-757d-4baa-bee5-476e3fab96a8 could not be found. Oct 17 03:13:06.617961 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: action_args: {'server_id': 'f4241d22-757d-4baa-bee5-476e3fab96a8'} Oct 17 03:13:06.618593 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 03:13:06.618593 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:13:06.618593 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 03:13:06.618593 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 03:13:06.618593 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 03:13:06.618593 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 03:13:06.618593 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 03:13:06.618593 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 03:13:06.618593 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 03:13:06.618593 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 03:13:06.618593 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4241d22-757d-4baa-bee5-476e3fab96a8 could not be found. Oct 17 03:13:06.618593 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Oct 17 03:13:06.618593 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:13:06.618593 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Oct 17 03:13:06.618593 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:13:06.618593 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:13:06.618593 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:13:06.618593 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 03:13:06.618593 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 03:13:06.618593 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 03:13:06.619661 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 03:13:06.619661 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 17 03:13:06.619661 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 03:13:06.619661 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 17 03:13:06.619661 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 03:13:06.619661 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 17 03:13:06.619661 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 17 03:13:06.619661 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 03:13:06.619661 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 03:13:06.619661 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4241d22-757d-4baa-bee5-476e3fab96a8 could not be found. Oct 17 03:13:06.619661 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Oct 17 03:13:06.619661 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:13:06.619661 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Oct 17 03:13:06.619661 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:13:06.619661 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:13:06.619661 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:13:06.619661 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 03:13:06.619661 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 03:13:06.619661 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4241d22-757d-4baa-bee5-476e3fab96a8 could not be found. Oct 17 03:13:06.619661 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Oct 17 03:13:06.622309 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-00df60a3-833e-4e41-9e7d-42d2062e6097 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Returning 404 to user: Instance f4241d22-757d-4baa-bee5-476e3fab96a8 could not be found. {{(pid=118886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 03:13:06.623451 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-00df60a3-833e-4e41-9e7d-42d2062e6097 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] 10.222.0.27 "GET /compute/v2.1/servers/f4241d22-757d-4baa-bee5-476e3fab96a8/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.055965 Oct 17 03:13:06.624087 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 112/212] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 17 03:13:06 2022] GET /compute/v2.1/servers/f4241d22-757d-4baa-bee5-476e3fab96a8/os-volume_attachments => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 03:13:06.828419 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-14512110-49dc-4393-bb15-057c67e0df6c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:13:06.829118 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-14512110-49dc-4393-bb15-057c67e0df6c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: f430d340-f7ff-4805-bd00-69eeaf33250d] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:13:06.839896 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-14512110-49dc-4393-bb15-057c67e0df6c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:06.842087 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-14512110-49dc-4393-bb15-057c67e0df6c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:06.842704 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-14512110-49dc-4393-bb15-057c67e0df6c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:06.844341 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-14512110-49dc-4393-bb15-057c67e0df6c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:06.844960 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-14512110-49dc-4393-bb15-057c67e0df6c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:06.845736 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-14512110-49dc-4393-bb15-057c67e0df6c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:07.061916 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-18369c87-0a52-47db-8d98-7aed68e727a2 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:13:07.062753 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-18369c87-0a52-47db-8d98-7aed68e727a2 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] [instance: c5bef4f0-63d6-4f68-aeec-a77348fd3921] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:13:07.070037 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-18369c87-0a52-47db-8d98-7aed68e727a2 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:07.071439 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-18369c87-0a52-47db-8d98-7aed68e727a2 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:07.072027 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-18369c87-0a52-47db-8d98-7aed68e727a2 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:07.072887 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-18369c87-0a52-47db-8d98-7aed68e727a2 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:07.073486 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-18369c87-0a52-47db-8d98-7aed68e727a2 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:07.074077 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-18369c87-0a52-47db-8d98-7aed68e727a2 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:07.156159 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-18369c87-0a52-47db-8d98-7aed68e727a2 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58fbb2d79954020aa1328ef6bf925e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b87c159313f74c77a95172124e82dc25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:13:07.165507 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-18369c87-0a52-47db-8d98-7aed68e727a2 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] 10.222.0.27 "GET /compute/v2.1/servers/c5bef4f0-63d6-4f68-aeec-a77348fd3921" status: 200 len: 1272 microversion: 2.1 time: 0.107293 Oct 17 03:13:07.179593 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 113/213] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:13:07 2022] GET /compute/v2.1/servers/c5bef4f0-63d6-4f68-aeec-a77348fd3921 => generated 1272 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:13:07.325759 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-14512110-49dc-4393-bb15-057c67e0df6c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1787a9ef7c44e28076aaa80c0152fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee21a91b84794e80b208fe72b7f1e010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:13:07.334233 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-14512110-49dc-4393-bb15-057c67e0df6c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "GET /compute/v2.1/servers/f430d340-f7ff-4805-bd00-69eeaf33250d" status: 200 len: 1522 microversion: 2.1 time: 0.510955 Oct 17 03:13:07.336449 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 101/214] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:13:06 2022] GET /compute/v2.1/servers/f430d340-f7ff-4805-bd00-69eeaf33250d => generated 1522 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:13:07.894545 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-ac086c70-5bf6-4bb2-9bcb-e74a784c24c9 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:13:07.895122 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-ac086c70-5bf6-4bb2-9bcb-e74a784c24c9 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] [instance: f4241d22-757d-4baa-bee5-476e3fab96a8] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:13:07.903452 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-ac086c70-5bf6-4bb2-9bcb-e74a784c24c9 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:07.904042 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-ac086c70-5bf6-4bb2-9bcb-e74a784c24c9 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:07.904887 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-ac086c70-5bf6-4bb2-9bcb-e74a784c24c9 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:07.906133 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-ac086c70-5bf6-4bb2-9bcb-e74a784c24c9 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:07.907189 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-ac086c70-5bf6-4bb2-9bcb-e74a784c24c9 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:07.908067 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-ac086c70-5bf6-4bb2-9bcb-e74a784c24c9 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:07.923825 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.wsgi [None req-ac086c70-5bf6-4bb2-9bcb-e74a784c24c9 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] HTTP exception thrown: Instance f4241d22-757d-4baa-bee5-476e3fab96a8 could not be found. Oct 17 03:13:07.926404 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-ac086c70-5bf6-4bb2-9bcb-e74a784c24c9 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Request method failure captured: Oct 17 03:13:07.926404 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: request: DELETE /compute/v2.1/servers/f4241d22-757d-4baa-bee5-476e3fab96a8 HTTP/1.1 Oct 17 03:13:07.926404 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Accept: application/json Oct 17 03:13:07.926404 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Accept-Encoding: identity Oct 17 03:13:07.926404 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Connection: close Oct 17 03:13:07.926404 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Content-Length: 0 Oct 17 03:13:07.926404 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Content-Type: application/json Oct 17 03:13:07.926404 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Host: 10.222.0.27 Oct 17 03:13:07.926404 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Openstack-System-Scope: None Oct 17 03:13:07.926404 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: User-Agent: python-urllib3/1.26.12 Oct 17 03:13:07.926404 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Auth-Token: gAAAAABjTMf-bC-ZNhy0wAe8-jyV6apHcx2OjnURQLZeYEzkG-TkxsYFgu2eJMSldcync4VenQsbqMkI7qShknoA7qyTKzIvgHbmnhJ_zq48PCOLW0Ar8x9J8onBmMzuqkcRsJCAuEbO9ldJS467JwkbZ1W2Dzc5KTbedcyCC9fCNa1BsHLTbtw Oct 17 03:13:07.926404 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Domain-Id: None Oct 17 03:13:07.926404 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Domain-Name: None Oct 17 03:13:07.926404 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Identity-Status: Confirmed Oct 17 03:13:07.926404 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Is-Admin-Project: True Oct 17 03:13:07.926404 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Project-Domain-Id: default Oct 17 03:13:07.926404 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Project-Domain-Name: Default Oct 17 03:13:07.926404 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Project-Id: d03f03d21e9e42fb91606306241a3fb7 Oct 17 03:13:07.926404 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Project-Name: tempest-DeleteServersTestJSON-1926001539 Oct 17 03:13:07.926404 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Role: member,reader Oct 17 03:13:07.926404 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Roles: member,reader Oct 17 03:13:07.927612 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d03f03d21e9e42fb91606306241a3fb7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d03f03d21e9e42fb91606306241a3fb7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d03f03d21e9e42fb91606306241a3fb7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d03f03d21e9e42fb91606306241a3fb7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 17 03:13:07.927612 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Tenant: tempest-DeleteServersTestJSON-1926001539 Oct 17 03:13:07.927612 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Tenant-Id: d03f03d21e9e42fb91606306241a3fb7 Oct 17 03:13:07.927612 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Tenant-Name: tempest-DeleteServersTestJSON-1926001539 Oct 17 03:13:07.927612 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-User: tempest-DeleteServersTestJSON-1926001539-project Oct 17 03:13:07.927612 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-User-Domain-Id: default Oct 17 03:13:07.927612 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-User-Domain-Name: Default Oct 17 03:13:07.927612 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-User-Id: 4443729a5a5341b6ad64f6fa131a5a54 Oct 17 03:13:07.927612 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-User-Name: tempest-DeleteServersTestJSON-1926001539-project Oct 17 03:13:07.927612 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: method: > Oct 17 03:13:07.927612 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: exception: Instance f4241d22-757d-4baa-bee5-476e3fab96a8 could not be found. Oct 17 03:13:07.927612 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: action_args: {'id': 'f4241d22-757d-4baa-bee5-476e3fab96a8'} Oct 17 03:13:07.928957 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 03:13:07.928957 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:13:07.928957 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 03:13:07.928957 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 03:13:07.928957 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 03:13:07.928957 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 03:13:07.928957 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 03:13:07.928957 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 03:13:07.928957 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 03:13:07.928957 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 03:13:07.928957 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4241d22-757d-4baa-bee5-476e3fab96a8 could not be found. Oct 17 03:13:07.928957 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Oct 17 03:13:07.928957 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:13:07.928957 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Oct 17 03:13:07.928957 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:13:07.928957 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:13:07.928957 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:13:07.928957 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 03:13:07.928957 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 03:13:07.928957 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 03:13:07.930146 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 03:13:07.930146 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 03:13:07.930146 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 03:13:07.930146 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 03:13:07.930146 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 03:13:07.930146 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 03:13:07.930146 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 03:13:07.930146 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 03:13:07.930146 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 03:13:07.930146 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4241d22-757d-4baa-bee5-476e3fab96a8 could not be found. Oct 17 03:13:07.930146 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Oct 17 03:13:07.930146 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:13:07.930146 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Oct 17 03:13:07.930146 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:13:07.930146 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:13:07.930146 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:13:07.930146 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 03:13:07.930146 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 03:13:07.930146 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4241d22-757d-4baa-bee5-476e3fab96a8 could not be found. Oct 17 03:13:07.930146 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Oct 17 03:13:07.933025 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-ac086c70-5bf6-4bb2-9bcb-e74a784c24c9 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Returning 404 to user: Instance f4241d22-757d-4baa-bee5-476e3fab96a8 could not be found. {{(pid=118886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 03:13:07.934111 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-ac086c70-5bf6-4bb2-9bcb-e74a784c24c9 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f4241d22-757d-4baa-bee5-476e3fab96a8" status: 404 len: 111 microversion: 2.1 time: 0.043532 Oct 17 03:13:07.938468 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 114/215] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 03:13:07 2022] DELETE /compute/v2.1/servers/f4241d22-757d-4baa-bee5-476e3fab96a8 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 03:13:07.943906 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-c953486d-26be-446d-b2ee-874f31dba5b6 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:13:07.944506 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-c953486d-26be-446d-b2ee-874f31dba5b6 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] [instance: f4241d22-757d-4baa-bee5-476e3fab96a8] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:13:07.951952 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-c953486d-26be-446d-b2ee-874f31dba5b6 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:07.952912 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-c953486d-26be-446d-b2ee-874f31dba5b6 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:07.953852 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-c953486d-26be-446d-b2ee-874f31dba5b6 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:07.955080 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-c953486d-26be-446d-b2ee-874f31dba5b6 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:07.955896 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-c953486d-26be-446d-b2ee-874f31dba5b6 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:07.956521 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-c953486d-26be-446d-b2ee-874f31dba5b6 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:07.971823 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.wsgi [None req-c953486d-26be-446d-b2ee-874f31dba5b6 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] HTTP exception thrown: Instance f4241d22-757d-4baa-bee5-476e3fab96a8 could not be found. Oct 17 03:13:07.973338 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-c953486d-26be-446d-b2ee-874f31dba5b6 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Request method failure captured: Oct 17 03:13:07.973338 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: request: GET /compute/v2.1/servers/f4241d22-757d-4baa-bee5-476e3fab96a8 HTTP/1.1 Oct 17 03:13:07.973338 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Accept: application/json Oct 17 03:13:07.973338 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Accept-Encoding: identity Oct 17 03:13:07.973338 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Connection: close Oct 17 03:13:07.973338 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Content-Length: 0 Oct 17 03:13:07.973338 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Content-Type: application/json Oct 17 03:13:07.973338 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Host: 10.222.0.27 Oct 17 03:13:07.973338 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Openstack-System-Scope: None Oct 17 03:13:07.973338 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: User-Agent: python-urllib3/1.26.12 Oct 17 03:13:07.973338 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Auth-Token: gAAAAABjTMf-bC-ZNhy0wAe8-jyV6apHcx2OjnURQLZeYEzkG-TkxsYFgu2eJMSldcync4VenQsbqMkI7qShknoA7qyTKzIvgHbmnhJ_zq48PCOLW0Ar8x9J8onBmMzuqkcRsJCAuEbO9ldJS467JwkbZ1W2Dzc5KTbedcyCC9fCNa1BsHLTbtw Oct 17 03:13:07.973338 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Domain-Id: None Oct 17 03:13:07.973338 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Domain-Name: None Oct 17 03:13:07.973338 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Identity-Status: Confirmed Oct 17 03:13:07.973338 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Is-Admin-Project: True Oct 17 03:13:07.973338 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Project-Domain-Id: default Oct 17 03:13:07.973338 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Project-Domain-Name: Default Oct 17 03:13:07.973338 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Project-Id: d03f03d21e9e42fb91606306241a3fb7 Oct 17 03:13:07.973338 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Project-Name: tempest-DeleteServersTestJSON-1926001539 Oct 17 03:13:07.973338 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Role: member,reader Oct 17 03:13:07.973338 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Roles: member,reader Oct 17 03:13:07.974488 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d03f03d21e9e42fb91606306241a3fb7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d03f03d21e9e42fb91606306241a3fb7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d03f03d21e9e42fb91606306241a3fb7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d03f03d21e9e42fb91606306241a3fb7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 17 03:13:07.974488 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Tenant: tempest-DeleteServersTestJSON-1926001539 Oct 17 03:13:07.974488 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Tenant-Id: d03f03d21e9e42fb91606306241a3fb7 Oct 17 03:13:07.974488 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Tenant-Name: tempest-DeleteServersTestJSON-1926001539 Oct 17 03:13:07.974488 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-User: tempest-DeleteServersTestJSON-1926001539-project Oct 17 03:13:07.974488 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-User-Domain-Id: default Oct 17 03:13:07.974488 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-User-Domain-Name: Default Oct 17 03:13:07.974488 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-User-Id: 4443729a5a5341b6ad64f6fa131a5a54 Oct 17 03:13:07.974488 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-User-Name: tempest-DeleteServersTestJSON-1926001539-project Oct 17 03:13:07.974488 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: method: > Oct 17 03:13:07.974488 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: exception: Instance f4241d22-757d-4baa-bee5-476e3fab96a8 could not be found. Oct 17 03:13:07.974488 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: action_args: {'id': 'f4241d22-757d-4baa-bee5-476e3fab96a8'} Oct 17 03:13:07.975803 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 03:13:07.975803 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:13:07.975803 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 03:13:07.975803 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 03:13:07.975803 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 03:13:07.975803 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 03:13:07.975803 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 03:13:07.975803 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 03:13:07.975803 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 03:13:07.975803 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 03:13:07.975803 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4241d22-757d-4baa-bee5-476e3fab96a8 could not be found. Oct 17 03:13:07.975803 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Oct 17 03:13:07.975803 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:13:07.975803 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Oct 17 03:13:07.975803 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:13:07.975803 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:13:07.975803 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:13:07.975803 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 03:13:07.975803 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 03:13:07.975803 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 03:13:07.976886 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 03:13:07.976886 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 03:13:07.976886 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 03:13:07.976886 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 03:13:07.976886 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 03:13:07.976886 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 03:13:07.976886 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 03:13:07.976886 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4241d22-757d-4baa-bee5-476e3fab96a8 could not be found. Oct 17 03:13:07.976886 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Oct 17 03:13:07.976886 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:13:07.976886 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Oct 17 03:13:07.976886 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:13:07.976886 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:13:07.976886 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:13:07.976886 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 03:13:07.976886 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 03:13:07.976886 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4241d22-757d-4baa-bee5-476e3fab96a8 could not be found. Oct 17 03:13:07.976886 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Oct 17 03:13:07.977804 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-c953486d-26be-446d-b2ee-874f31dba5b6 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] Returning 404 to user: Instance f4241d22-757d-4baa-bee5-476e3fab96a8 could not be found. {{(pid=118887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 03:13:07.977804 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-c953486d-26be-446d-b2ee-874f31dba5b6 tempest-DeleteServersTestJSON-1926001539 tempest-DeleteServersTestJSON-1926001539-project] 10.222.0.27 "GET /compute/v2.1/servers/f4241d22-757d-4baa-bee5-476e3fab96a8" status: 404 len: 111 microversion: 2.1 time: 0.035001 Oct 17 03:13:07.977804 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 102/216] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:13:07 2022] GET /compute/v2.1/servers/f4241d22-757d-4baa-bee5-476e3fab96a8 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 03:13:08.198983 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-070b572d-4958-47f6-a975-141d8d7df8d7 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:13:08.202962 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-070b572d-4958-47f6-a975-141d8d7df8d7 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] [instance: c5bef4f0-63d6-4f68-aeec-a77348fd3921] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:13:08.216457 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-070b572d-4958-47f6-a975-141d8d7df8d7 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:08.217315 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-070b572d-4958-47f6-a975-141d8d7df8d7 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:08.218004 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-070b572d-4958-47f6-a975-141d8d7df8d7 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:08.219187 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-070b572d-4958-47f6-a975-141d8d7df8d7 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:08.219783 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-070b572d-4958-47f6-a975-141d8d7df8d7 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:08.220335 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-070b572d-4958-47f6-a975-141d8d7df8d7 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:08.379975 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-89741d8a-6480-4e44-95ba-16905a274791 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:13:08.380920 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-89741d8a-6480-4e44-95ba-16905a274791 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: f430d340-f7ff-4805-bd00-69eeaf33250d] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:13:08.419709 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-89741d8a-6480-4e44-95ba-16905a274791 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:08.420884 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-89741d8a-6480-4e44-95ba-16905a274791 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:08.423661 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-89741d8a-6480-4e44-95ba-16905a274791 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:08.432572 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-89741d8a-6480-4e44-95ba-16905a274791 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:08.432572 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-89741d8a-6480-4e44-95ba-16905a274791 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:08.432572 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-89741d8a-6480-4e44-95ba-16905a274791 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:08.640358 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-070b572d-4958-47f6-a975-141d8d7df8d7 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58fbb2d79954020aa1328ef6bf925e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b87c159313f74c77a95172124e82dc25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:13:08.648474 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-070b572d-4958-47f6-a975-141d8d7df8d7 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] 10.222.0.27 "GET /compute/v2.1/servers/c5bef4f0-63d6-4f68-aeec-a77348fd3921" status: 200 len: 1314 microversion: 2.1 time: 0.461665 Oct 17 03:13:08.650455 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 115/217] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:13:08 2022] GET /compute/v2.1/servers/c5bef4f0-63d6-4f68-aeec-a77348fd3921 => generated 1314 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:13:08.655827 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [req-4c6d6783-c2b0-4ad9-95c5-12fdecc134ff req-2e4b4535-747e-4058-b4e7-38979feddfb6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5bef4f0-63d6-4f68-aeec-a77348fd3921", "tag": "7fb9edbd-1a95-4c9b-bafa-7879c03c7674"}]} {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:13:08.682785 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [req-4c6d6783-c2b0-4ad9-95c5-12fdecc134ff req-2e4b4535-747e-4058-b4e7-38979feddfb6 service nova] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:08.687223 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [req-4c6d6783-c2b0-4ad9-95c5-12fdecc134ff req-2e4b4535-747e-4058-b4e7-38979feddfb6 service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:08.688513 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [req-4c6d6783-c2b0-4ad9-95c5-12fdecc134ff req-2e4b4535-747e-4058-b4e7-38979feddfb6 service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:08.714711 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.compute.server_external_events [req-4c6d6783-c2b0-4ad9-95c5-12fdecc134ff req-2e4b4535-747e-4058-b4e7-38979feddfb6 service nova] Creating event network-changed:7fb9edbd-1a95-4c9b-bafa-7879c03c7674 for instance c5bef4f0-63d6-4f68-aeec-a77348fd3921 on hv-cinder-84697 Oct 17 03:13:08.727364 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [req-4c6d6783-c2b0-4ad9-95c5-12fdecc134ff req-2e4b4535-747e-4058-b4e7-38979feddfb6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075290 Oct 17 03:13:08.734198 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 116/218] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 03:13:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:13:08.915993 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-89741d8a-6480-4e44-95ba-16905a274791 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1787a9ef7c44e28076aaa80c0152fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee21a91b84794e80b208fe72b7f1e010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:13:08.929027 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-89741d8a-6480-4e44-95ba-16905a274791 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "GET /compute/v2.1/servers/f430d340-f7ff-4805-bd00-69eeaf33250d" status: 200 len: 1522 microversion: 2.1 time: 0.571984 Oct 17 03:13:08.932320 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 103/219] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:13:08 2022] GET /compute/v2.1/servers/f430d340-f7ff-4805-bd00-69eeaf33250d => generated 1522 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:13:09.678028 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-4d684f1e-4f98-4497-8101-cde2448a36dd tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:13:09.679372 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-4d684f1e-4f98-4497-8101-cde2448a36dd tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] [instance: c5bef4f0-63d6-4f68-aeec-a77348fd3921] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:13:09.688229 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-4d684f1e-4f98-4497-8101-cde2448a36dd tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:09.688808 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-4d684f1e-4f98-4497-8101-cde2448a36dd tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:09.689298 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-4d684f1e-4f98-4497-8101-cde2448a36dd tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:09.690093 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-4d684f1e-4f98-4497-8101-cde2448a36dd tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:09.690935 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-4d684f1e-4f98-4497-8101-cde2448a36dd tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:09.691050 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-4d684f1e-4f98-4497-8101-cde2448a36dd tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:09.942620 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-4d684f1e-4f98-4497-8101-cde2448a36dd tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58fbb2d79954020aa1328ef6bf925e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b87c159313f74c77a95172124e82dc25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:13:09.955498 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-317f4b7d-94d4-4d75-b487-0ec68dc837e3 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:13:09.956777 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-317f4b7d-94d4-4d75-b487-0ec68dc837e3 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: f430d340-f7ff-4805-bd00-69eeaf33250d] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:13:09.970033 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-4d684f1e-4f98-4497-8101-cde2448a36dd tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] 10.222.0.27 "GET /compute/v2.1/servers/c5bef4f0-63d6-4f68-aeec-a77348fd3921" status: 200 len: 1314 microversion: 2.1 time: 0.297612 Oct 17 03:13:09.973486 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-317f4b7d-94d4-4d75-b487-0ec68dc837e3 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:09.973977 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-317f4b7d-94d4-4d75-b487-0ec68dc837e3 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:09.974404 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-317f4b7d-94d4-4d75-b487-0ec68dc837e3 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:09.975497 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 117/220] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:13:09 2022] GET /compute/v2.1/servers/c5bef4f0-63d6-4f68-aeec-a77348fd3921 => generated 1314 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:13:09.975612 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-317f4b7d-94d4-4d75-b487-0ec68dc837e3 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:09.976102 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-317f4b7d-94d4-4d75-b487-0ec68dc837e3 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:09.976529 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-317f4b7d-94d4-4d75-b487-0ec68dc837e3 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:10.135583 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-317f4b7d-94d4-4d75-b487-0ec68dc837e3 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1787a9ef7c44e28076aaa80c0152fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee21a91b84794e80b208fe72b7f1e010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:13:10.143779 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-317f4b7d-94d4-4d75-b487-0ec68dc837e3 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "GET /compute/v2.1/servers/f430d340-f7ff-4805-bd00-69eeaf33250d" status: 200 len: 1522 microversion: 2.1 time: 0.193067 Oct 17 03:13:10.159406 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 104/221] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:13:09 2022] GET /compute/v2.1/servers/f430d340-f7ff-4805-bd00-69eeaf33250d => generated 1522 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:13:10.580652 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-314afa05-a76d-497a-a3ef-26d594255b19 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1661247647", "imageRef": "e6d41914-f1bc-4b72-9113-1a69b3d0d83b", "flavorRef": "452", "networks": [{"uuid": "8f1e2c13-b4f2-4e53-81bc-b89ddf861600"}]}} {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:13:10.675032 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.network.neutron [None req-314afa05-a76d-497a-a3ef-26d594255b19 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] validate_networks() for [('8f1e2c13-b4f2-4e53-81bc-b89ddf861600', None, None, None, None, None)] {{(pid=118886) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 03:13:11.002398 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-a739aeba-be72-4e63-a19b-fc078403bc2c tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:13:11.003694 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-a739aeba-be72-4e63-a19b-fc078403bc2c tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] [instance: c5bef4f0-63d6-4f68-aeec-a77348fd3921] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:13:11.014437 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-a739aeba-be72-4e63-a19b-fc078403bc2c tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:11.015291 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-a739aeba-be72-4e63-a19b-fc078403bc2c tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:11.015879 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-a739aeba-be72-4e63-a19b-fc078403bc2c tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:11.016742 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-a739aeba-be72-4e63-a19b-fc078403bc2c tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:11.017539 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-a739aeba-be72-4e63-a19b-fc078403bc2c tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:11.017969 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-a739aeba-be72-4e63-a19b-fc078403bc2c tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:11.182342 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-a739aeba-be72-4e63-a19b-fc078403bc2c tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58fbb2d79954020aa1328ef6bf925e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b87c159313f74c77a95172124e82dc25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:13:11.190825 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-a739aeba-be72-4e63-a19b-fc078403bc2c tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] 10.222.0.27 "GET /compute/v2.1/servers/c5bef4f0-63d6-4f68-aeec-a77348fd3921" status: 200 len: 1314 microversion: 2.1 time: 0.199734 Oct 17 03:13:11.191441 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 105/222] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:13:10 2022] GET /compute/v2.1/servers/c5bef4f0-63d6-4f68-aeec-a77348fd3921 => generated 1314 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:13:11.203226 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-8c86c906-405f-4288-95c0-b96b28dc374b tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:13:11.204138 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-8c86c906-405f-4288-95c0-b96b28dc374b tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: f430d340-f7ff-4805-bd00-69eeaf33250d] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:13:11.211627 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-8c86c906-405f-4288-95c0-b96b28dc374b tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:11.212172 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-8c86c906-405f-4288-95c0-b96b28dc374b tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:11.212634 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-8c86c906-405f-4288-95c0-b96b28dc374b tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:11.213467 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-8c86c906-405f-4288-95c0-b96b28dc374b tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:11.214123 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-8c86c906-405f-4288-95c0-b96b28dc374b tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:11.214590 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-8c86c906-405f-4288-95c0-b96b28dc374b tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:11.363761 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-8c86c906-405f-4288-95c0-b96b28dc374b tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1787a9ef7c44e28076aaa80c0152fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee21a91b84794e80b208fe72b7f1e010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:13:11.371647 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-8c86c906-405f-4288-95c0-b96b28dc374b tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "GET /compute/v2.1/servers/f430d340-f7ff-4805-bd00-69eeaf33250d" status: 200 len: 1522 microversion: 2.1 time: 0.179068 Oct 17 03:13:11.372215 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 106/223] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:13:11 2022] GET /compute/v2.1/servers/f430d340-f7ff-4805-bd00-69eeaf33250d => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:13:11.753990 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.virt.hardware [None req-314afa05-a76d-497a-a3ef-26d594255b19 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Flavor limits 0:0:0 {{(pid=118886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 03:13:11.754991 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.virt.hardware [None req-314afa05-a76d-497a-a3ef-26d594255b19 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Image limits 0:0:0 {{(pid=118886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 03:13:11.755469 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.virt.hardware [None req-314afa05-a76d-497a-a3ef-26d594255b19 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Flavor pref 0:0:0 {{(pid=118886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 03:13:11.755981 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.virt.hardware [None req-314afa05-a76d-497a-a3ef-26d594255b19 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Image pref 0:0:0 {{(pid=118886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 03:13:11.756429 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.virt.hardware [None req-314afa05-a76d-497a-a3ef-26d594255b19 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 03:13:11.765304 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-314afa05-a76d-497a-a3ef-26d594255b19 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:11.765855 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-314afa05-a76d-497a-a3ef-26d594255b19 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:11.766289 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-314afa05-a76d-497a-a3ef-26d594255b19 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:11.769552 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-314afa05-a76d-497a-a3ef-26d594255b19 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:11.770019 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-314afa05-a76d-497a-a3ef-26d594255b19 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:11.770613 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-314afa05-a76d-497a-a3ef-26d594255b19 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:11.790338 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.quota [None req-314afa05-a76d-497a-a3ef-26d594255b19 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Getting quotas for project 0d285ecc0c5343b1b4001594013cd447. Resources: {'instances', 'cores', 'ram'} {{(pid=118886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 03:13:11.794625 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.quota [None req-314afa05-a76d-497a-a3ef-26d594255b19 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Getting quotas for user 7cc092c3cc0b4fbc9b420b8c7916132a and project 0d285ecc0c5343b1b4001594013cd447. Resources: {'instances', 'cores', 'ram'} {{(pid=118886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 03:13:11.809249 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-314afa05-a76d-497a-a3ef-26d594255b19 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Going to run 1 instances... {{(pid=118886) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 03:13:11.811581 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-314afa05-a76d-497a-a3ef-26d594255b19 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] [instance: d7fc9f01-479b-43e9-9415-fe96b7140a47] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e6d41914-f1bc-4b72-9113-1a69b3d0d83b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 03:13:11.869829 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-314afa05-a76d-497a-a3ef-26d594255b19 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.292783 Oct 17 03:13:11.870589 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 118/224] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 03:13:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 1295 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 03:13:11.882003 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-20dab874-9f0e-4a7d-8710-d0b019975fa2 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:13:11.882661 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-20dab874-9f0e-4a7d-8710-d0b019975fa2 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] [instance: d7fc9f01-479b-43e9-9415-fe96b7140a47] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:13:11.884742 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG dbcounter [-] [118887] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=1 {{(pid=118887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:13:11.985345 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-20dab874-9f0e-4a7d-8710-d0b019975fa2 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc092c3cc0b4fbc9b420b8c7916132a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d285ecc0c5343b1b4001594013cd447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:13:12.000196 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-20dab874-9f0e-4a7d-8710-d0b019975fa2 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] 10.222.0.27 "GET /compute/v2.1/servers/d7fc9f01-479b-43e9-9415-fe96b7140a47" status: 200 len: 1219 microversion: 2.1 time: 0.122391 Oct 17 03:13:12.002135 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 107/225] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:13:11 2022] GET /compute/v2.1/servers/d7fc9f01-479b-43e9-9415-fe96b7140a47 => generated 1219 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:13:12.227131 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-31060bf8-75a3-4930-9949-9b56b946d9bc tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:13:12.228306 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-31060bf8-75a3-4930-9949-9b56b946d9bc tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] [instance: c5bef4f0-63d6-4f68-aeec-a77348fd3921] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:13:12.235566 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-31060bf8-75a3-4930-9949-9b56b946d9bc tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:12.236280 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-31060bf8-75a3-4930-9949-9b56b946d9bc tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:12.236717 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-31060bf8-75a3-4930-9949-9b56b946d9bc tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:12.237566 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-31060bf8-75a3-4930-9949-9b56b946d9bc tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:12.238419 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-31060bf8-75a3-4930-9949-9b56b946d9bc tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:12.239071 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-31060bf8-75a3-4930-9949-9b56b946d9bc tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:12.394690 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-a4bbd624-794e-4784-b4f2-ed66cd21090f tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:13:12.395336 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-a4bbd624-794e-4784-b4f2-ed66cd21090f tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: f430d340-f7ff-4805-bd00-69eeaf33250d] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:13:12.405759 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-a4bbd624-794e-4784-b4f2-ed66cd21090f tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:12.414685 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-a4bbd624-794e-4784-b4f2-ed66cd21090f tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:12.416694 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-a4bbd624-794e-4784-b4f2-ed66cd21090f tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:12.418317 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-a4bbd624-794e-4784-b4f2-ed66cd21090f tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:12.422266 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-a4bbd624-794e-4784-b4f2-ed66cd21090f tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:12.431485 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-a4bbd624-794e-4784-b4f2-ed66cd21090f tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:12.575595 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-31060bf8-75a3-4930-9949-9b56b946d9bc tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58fbb2d79954020aa1328ef6bf925e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b87c159313f74c77a95172124e82dc25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:13:12.589910 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-31060bf8-75a3-4930-9949-9b56b946d9bc tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] 10.222.0.27 "GET /compute/v2.1/servers/c5bef4f0-63d6-4f68-aeec-a77348fd3921" status: 200 len: 1314 microversion: 2.1 time: 0.370578 Oct 17 03:13:12.611814 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 119/226] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:13:12 2022] GET /compute/v2.1/servers/c5bef4f0-63d6-4f68-aeec-a77348fd3921 => generated 1314 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:13:12.730721 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-a4bbd624-794e-4784-b4f2-ed66cd21090f tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1787a9ef7c44e28076aaa80c0152fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee21a91b84794e80b208fe72b7f1e010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:13:12.741787 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-a4bbd624-794e-4784-b4f2-ed66cd21090f tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "GET /compute/v2.1/servers/f430d340-f7ff-4805-bd00-69eeaf33250d" status: 200 len: 1522 microversion: 2.1 time: 0.349605 Oct 17 03:13:12.742493 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 108/227] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:13:12 2022] GET /compute/v2.1/servers/f430d340-f7ff-4805-bd00-69eeaf33250d => generated 1522 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:13:13.024376 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-b025366f-3f44-481d-ab1b-9ebbe8c78083 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:13:13.025260 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-b025366f-3f44-481d-ab1b-9ebbe8c78083 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] [instance: d7fc9f01-479b-43e9-9415-fe96b7140a47] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:13:13.030008 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG dbcounter [-] [118886] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6 {{(pid=118886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:13:13.049960 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-b025366f-3f44-481d-ab1b-9ebbe8c78083 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:13.050755 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-b025366f-3f44-481d-ab1b-9ebbe8c78083 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:13.051493 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-b025366f-3f44-481d-ab1b-9ebbe8c78083 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:13.055852 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-b025366f-3f44-481d-ab1b-9ebbe8c78083 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:13.056422 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-b025366f-3f44-481d-ab1b-9ebbe8c78083 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:13.056914 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-b025366f-3f44-481d-ab1b-9ebbe8c78083 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:13.174102 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-b025366f-3f44-481d-ab1b-9ebbe8c78083 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc092c3cc0b4fbc9b420b8c7916132a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d285ecc0c5343b1b4001594013cd447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:13:13.183013 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-b025366f-3f44-481d-ab1b-9ebbe8c78083 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] 10.222.0.27 "GET /compute/v2.1/servers/d7fc9f01-479b-43e9-9415-fe96b7140a47" status: 200 len: 1271 microversion: 2.1 time: 0.162704 Oct 17 03:13:13.183790 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 120/228] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:13:13 2022] GET /compute/v2.1/servers/d7fc9f01-479b-43e9-9415-fe96b7140a47 => generated 1271 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:13:13.623238 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-da30978f-5b66-4837-9e9f-2b5663e16638 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:13:13.623756 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-da30978f-5b66-4837-9e9f-2b5663e16638 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] [instance: c5bef4f0-63d6-4f68-aeec-a77348fd3921] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:13:13.629686 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-da30978f-5b66-4837-9e9f-2b5663e16638 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:13.630164 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-da30978f-5b66-4837-9e9f-2b5663e16638 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:13.630591 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-da30978f-5b66-4837-9e9f-2b5663e16638 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:13.632049 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-da30978f-5b66-4837-9e9f-2b5663e16638 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:13.632508 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-da30978f-5b66-4837-9e9f-2b5663e16638 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:13.632931 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-da30978f-5b66-4837-9e9f-2b5663e16638 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:13.767118 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-2fc29b04-2303-4ab8-906a-f586dc345a50 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:13:13.768296 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-2fc29b04-2303-4ab8-906a-f586dc345a50 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: f430d340-f7ff-4805-bd00-69eeaf33250d] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:13:13.775633 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-2fc29b04-2303-4ab8-906a-f586dc345a50 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:13.776219 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-2fc29b04-2303-4ab8-906a-f586dc345a50 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:13.776348 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-da30978f-5b66-4837-9e9f-2b5663e16638 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58fbb2d79954020aa1328ef6bf925e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b87c159313f74c77a95172124e82dc25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:13:13.776992 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-2fc29b04-2303-4ab8-906a-f586dc345a50 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:13.778019 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-2fc29b04-2303-4ab8-906a-f586dc345a50 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:13.778535 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-2fc29b04-2303-4ab8-906a-f586dc345a50 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:13.779642 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-2fc29b04-2303-4ab8-906a-f586dc345a50 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:13.787548 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-da30978f-5b66-4837-9e9f-2b5663e16638 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] 10.222.0.27 "GET /compute/v2.1/servers/c5bef4f0-63d6-4f68-aeec-a77348fd3921" status: 200 len: 1314 microversion: 2.1 time: 0.167970 Oct 17 03:13:13.788367 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 109/229] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:13:13 2022] GET /compute/v2.1/servers/c5bef4f0-63d6-4f68-aeec-a77348fd3921 => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:13:13.945227 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-2fc29b04-2303-4ab8-906a-f586dc345a50 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1787a9ef7c44e28076aaa80c0152fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee21a91b84794e80b208fe72b7f1e010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:13:13.953458 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-2fc29b04-2303-4ab8-906a-f586dc345a50 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "GET /compute/v2.1/servers/f430d340-f7ff-4805-bd00-69eeaf33250d" status: 200 len: 1522 microversion: 2.1 time: 0.191652 Oct 17 03:13:13.955045 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 121/230] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:13:13 2022] GET /compute/v2.1/servers/f430d340-f7ff-4805-bd00-69eeaf33250d => generated 1522 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:13:14.207078 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-4799dd20-eb9d-41c9-bcd5-9f21ecf5df4a tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:13:14.207922 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-4799dd20-eb9d-41c9-bcd5-9f21ecf5df4a tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] [instance: d7fc9f01-479b-43e9-9415-fe96b7140a47] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:13:14.216500 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-4799dd20-eb9d-41c9-bcd5-9f21ecf5df4a tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:14.217216 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-4799dd20-eb9d-41c9-bcd5-9f21ecf5df4a tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:14.217857 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-4799dd20-eb9d-41c9-bcd5-9f21ecf5df4a tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:14.221491 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-4799dd20-eb9d-41c9-bcd5-9f21ecf5df4a tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:14.222013 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-4799dd20-eb9d-41c9-bcd5-9f21ecf5df4a tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:14.222665 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-4799dd20-eb9d-41c9-bcd5-9f21ecf5df4a tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:14.230601 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG dbcounter [-] [118887] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:13:14.320453 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-4799dd20-eb9d-41c9-bcd5-9f21ecf5df4a tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc092c3cc0b4fbc9b420b8c7916132a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d285ecc0c5343b1b4001594013cd447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:13:14.330776 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-4799dd20-eb9d-41c9-bcd5-9f21ecf5df4a tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] 10.222.0.27 "GET /compute/v2.1/servers/d7fc9f01-479b-43e9-9415-fe96b7140a47" status: 200 len: 1277 microversion: 2.1 time: 0.127451 Oct 17 03:13:14.331381 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 110/231] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:13:14 2022] GET /compute/v2.1/servers/d7fc9f01-479b-43e9-9415-fe96b7140a47 => generated 1277 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:13:14.634301 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [req-9c555095-dab1-4f64-a4bf-afc75b057da2 req-b2bd873f-a573-46ff-bbd0-42dafdc8e4bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5bef4f0-63d6-4f68-aeec-a77348fd3921", "name": "network-vif-plugged", "status": "completed", "tag": "7fb9edbd-1a95-4c9b-bafa-7879c03c7674"}]} {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:13:14.654560 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [req-9c555095-dab1-4f64-a4bf-afc75b057da2 req-b2bd873f-a573-46ff-bbd0-42dafdc8e4bb service nova] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:14.654995 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [req-9c555095-dab1-4f64-a4bf-afc75b057da2 req-b2bd873f-a573-46ff-bbd0-42dafdc8e4bb service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:14.655419 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [req-9c555095-dab1-4f64-a4bf-afc75b057da2 req-b2bd873f-a573-46ff-bbd0-42dafdc8e4bb service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:14.669493 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.compute.server_external_events [req-9c555095-dab1-4f64-a4bf-afc75b057da2 req-b2bd873f-a573-46ff-bbd0-42dafdc8e4bb service nova] Creating event network-vif-plugged:7fb9edbd-1a95-4c9b-bafa-7879c03c7674 for instance c5bef4f0-63d6-4f68-aeec-a77348fd3921 on hv-cinder-84697 Oct 17 03:13:14.675557 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [req-9c555095-dab1-4f64-a4bf-afc75b057da2 req-b2bd873f-a573-46ff-bbd0-42dafdc8e4bb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046577 Oct 17 03:13:14.676610 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 111/232] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 03:13:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:13:14.717969 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-7dfb542f-e655-47d2-9000-f5a9c61ed951 tempest-VolumesNegativeTest-2140190560 tempest-VolumesNegativeTest-2140190560-project] Action: 'create', calling method: .version_select at 0x7fc701975b80>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-460601184", "metadata": {"Type": "work"}}} {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:13:14.767463 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-7dfb542f-e655-47d2-9000-f5a9c61ed951 tempest-VolumesNegativeTest-2140190560 tempest-VolumesNegativeTest-2140190560-project] Request method failure captured: Oct 17 03:13:14.767463 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 17 03:13:14.767463 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Accept: application/json Oct 17 03:13:14.767463 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Accept-Encoding: identity Oct 17 03:13:14.767463 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Connection: close Oct 17 03:13:14.767463 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Content-Length: 121 Oct 17 03:13:14.767463 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Content-Type: application/json Oct 17 03:13:14.767463 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Host: 10.222.0.27 Oct 17 03:13:14.767463 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Openstack-System-Scope: None Oct 17 03:13:14.767463 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: User-Agent: python-urllib3/1.26.12 Oct 17 03:13:14.767463 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Auth-Token: gAAAAABjTMhKZPHRhDub_Cc-tTXFx8eEQqyp0gl-y-sjmlIs5SjRzO0LXUB51Kftqjr1g12poOWnnXGOQnRzyRPRMECkCoUxxCTWNTDUk0mZRlcQrBfY2_f_1scXTPHRRUKYt1RBMGjEqbKt8rkEojYcAF1t_ZWeX6PuOYk59dTQi3a6o_2gpLk Oct 17 03:13:14.767463 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Domain-Id: None Oct 17 03:13:14.767463 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Domain-Name: None Oct 17 03:13:14.767463 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Identity-Status: Confirmed Oct 17 03:13:14.767463 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Is-Admin-Project: True Oct 17 03:13:14.767463 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Project-Domain-Id: default Oct 17 03:13:14.767463 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Project-Domain-Name: Default Oct 17 03:13:14.767463 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Project-Id: ba1ddde60ab04563b3601961f3b36eea Oct 17 03:13:14.767463 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Project-Name: tempest-VolumesNegativeTest-2140190560 Oct 17 03:13:14.767463 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Role: member,reader Oct 17 03:13:14.767463 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Roles: member,reader Oct 17 03:13:14.768933 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ba1ddde60ab04563b3601961f3b36eea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ba1ddde60ab04563b3601961f3b36eea"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ba1ddde60ab04563b3601961f3b36eea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ba1ddde60ab04563b3601961f3b36eea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 17 03:13:14.768933 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Tenant: tempest-VolumesNegativeTest-2140190560 Oct 17 03:13:14.768933 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Tenant-Id: ba1ddde60ab04563b3601961f3b36eea Oct 17 03:13:14.768933 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Tenant-Name: tempest-VolumesNegativeTest-2140190560 Oct 17 03:13:14.768933 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-User: tempest-VolumesNegativeTest-2140190560-project Oct 17 03:13:14.768933 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-User-Domain-Id: default Oct 17 03:13:14.768933 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-User-Domain-Name: Default Oct 17 03:13:14.768933 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-User-Id: 5696f411c2d640f1a0e1d3309f6f422a Oct 17 03:13:14.768933 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-User-Name: tempest-VolumesNegativeTest-2140190560-project Oct 17 03:13:14.768933 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Oct 17 03:13:14.768933 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-460601184", "metadata": {"Type": "work"}}} Oct 17 03:13:14.768933 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: method: Oct 17 03:13:14.768933 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 17 03:13:14.769748 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-460601184', 'metadata': {'Type': 'work'}}}} Oct 17 03:13:14.769748 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 03:13:14.769748 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:13:14.769748 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 03:13:14.769748 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 03:13:14.769748 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 03:13:14.769748 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi raise error Oct 17 03:13:14.769748 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Oct 17 03:13:14.769748 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Oct 17 03:13:14.769748 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 17 03:13:14.769748 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 17 03:13:14.769748 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Oct 17 03:13:14.769748 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 17 03:13:14.769748 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi '#$%' Oct 17 03:13:14.769748 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Oct 17 03:13:14.769748 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:13:14.769748 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Oct 17 03:13:14.769748 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:13:14.769748 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:13:14.769748 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:13:14.769748 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 03:13:14.769748 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 03:13:14.771129 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 03:13:14.771129 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 03:13:14.771129 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 03:13:14.771129 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 03:13:14.771129 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 17 03:13:14.771129 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 17 03:13:14.771129 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 03:13:14.771129 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 03:13:14.771129 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 03:13:14.771129 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 03:13:14.771129 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 17 03:13:14.771129 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Oct 17 03:13:14.771129 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:13:14.771129 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Oct 17 03:13:14.771129 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:13:14.771129 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:13:14.771129 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:13:14.771129 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 03:13:14.771129 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 03:13:14.772662 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 17 03:13:14.772662 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Oct 17 03:13:14.772662 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-7dfb542f-e655-47d2-9000-f5a9c61ed951 tempest-VolumesNegativeTest-2140190560 tempest-VolumesNegativeTest-2140190560-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=118886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 03:13:14.772662 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-7dfb542f-e655-47d2-9000-f5a9c61ed951 tempest-VolumesNegativeTest-2140190560 tempest-VolumesNegativeTest-2140190560-project] 10.222.0.27 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.198797 Oct 17 03:13:14.772662 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 122/233] 10.222.0.27 () {60 vars in 1156 bytes} [Mon Oct 17 03:13:14 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 200 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 03:13:14.783791 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-d621979a-ec93-481e-b92f-8c3e0cd46bd8 tempest-VolumesNegativeTest-2140190560 tempest-VolumesNegativeTest-2140190560-project] Action: 'create', calling method: .version_select at 0x7fc7019aa280>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2010446558", "metadata": {"Type": "work"}}} {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:13:14.790309 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-d621979a-ec93-481e-b92f-8c3e0cd46bd8 tempest-VolumesNegativeTest-2140190560 tempest-VolumesNegativeTest-2140190560-project] Request method failure captured: Oct 17 03:13:14.790309 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 17 03:13:14.790309 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Accept: application/json Oct 17 03:13:14.790309 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Accept-Encoding: identity Oct 17 03:13:14.790309 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Connection: close Oct 17 03:13:14.790309 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Content-Length: 120 Oct 17 03:13:14.790309 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Content-Type: application/json Oct 17 03:13:14.790309 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Host: 10.222.0.27 Oct 17 03:13:14.790309 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Openstack-System-Scope: None Oct 17 03:13:14.790309 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: User-Agent: python-urllib3/1.26.12 Oct 17 03:13:14.790309 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Auth-Token: gAAAAABjTMhKZPHRhDub_Cc-tTXFx8eEQqyp0gl-y-sjmlIs5SjRzO0LXUB51Kftqjr1g12poOWnnXGOQnRzyRPRMECkCoUxxCTWNTDUk0mZRlcQrBfY2_f_1scXTPHRRUKYt1RBMGjEqbKt8rkEojYcAF1t_ZWeX6PuOYk59dTQi3a6o_2gpLk Oct 17 03:13:14.790309 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Domain-Id: None Oct 17 03:13:14.790309 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Domain-Name: None Oct 17 03:13:14.790309 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Identity-Status: Confirmed Oct 17 03:13:14.790309 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Is-Admin-Project: True Oct 17 03:13:14.790309 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Project-Domain-Id: default Oct 17 03:13:14.790309 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Project-Domain-Name: Default Oct 17 03:13:14.790309 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Project-Id: ba1ddde60ab04563b3601961f3b36eea Oct 17 03:13:14.790309 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Project-Name: tempest-VolumesNegativeTest-2140190560 Oct 17 03:13:14.790309 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Role: member,reader Oct 17 03:13:14.790309 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Roles: member,reader Oct 17 03:13:14.791565 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ba1ddde60ab04563b3601961f3b36eea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ba1ddde60ab04563b3601961f3b36eea"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ba1ddde60ab04563b3601961f3b36eea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ba1ddde60ab04563b3601961f3b36eea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 17 03:13:14.791565 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Tenant: tempest-VolumesNegativeTest-2140190560 Oct 17 03:13:14.791565 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Tenant-Id: ba1ddde60ab04563b3601961f3b36eea Oct 17 03:13:14.791565 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Tenant-Name: tempest-VolumesNegativeTest-2140190560 Oct 17 03:13:14.791565 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-User: tempest-VolumesNegativeTest-2140190560-project Oct 17 03:13:14.791565 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-User-Domain-Id: default Oct 17 03:13:14.791565 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-User-Domain-Name: Default Oct 17 03:13:14.791565 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-User-Id: 5696f411c2d640f1a0e1d3309f6f422a Oct 17 03:13:14.791565 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-User-Name: tempest-VolumesNegativeTest-2140190560-project Oct 17 03:13:14.791565 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Oct 17 03:13:14.791565 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2010446558", "metadata": {"Type": "work"}}} Oct 17 03:13:14.791565 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: method: Oct 17 03:13:14.791565 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 17 03:13:14.792254 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-2010446558', 'metadata': {'Type': 'work'}}}} Oct 17 03:13:14.792254 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 03:13:14.792254 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:13:14.792254 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 03:13:14.792254 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 03:13:14.792254 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 03:13:14.792254 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi raise error Oct 17 03:13:14.792254 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 17 03:13:14.792254 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Oct 17 03:13:14.792254 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Oct 17 03:13:14.792254 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 17 03:13:14.792254 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Oct 17 03:13:14.792254 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 17 03:13:14.792254 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi '0' Oct 17 03:13:14.792254 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Oct 17 03:13:14.792254 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:13:14.792254 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Oct 17 03:13:14.792254 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:13:14.792254 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:13:14.792254 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:13:14.792254 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 03:13:14.792254 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 03:13:14.793681 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 03:13:14.793681 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 03:13:14.793681 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 03:13:14.793681 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 03:13:14.793681 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 17 03:13:14.793681 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 17 03:13:14.793681 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 03:13:14.793681 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 03:13:14.793681 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 03:13:14.793681 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 03:13:14.793681 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 17 03:13:14.793681 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Oct 17 03:13:14.793681 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:13:14.793681 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Oct 17 03:13:14.793681 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:13:14.793681 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:13:14.793681 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:13:14.793681 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 03:13:14.793681 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 03:13:14.794683 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 17 03:13:14.794683 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Oct 17 03:13:14.794683 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-d621979a-ec93-481e-b92f-8c3e0cd46bd8 tempest-VolumesNegativeTest-2140190560 tempest-VolumesNegativeTest-2140190560-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=118887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 03:13:14.794683 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-d621979a-ec93-481e-b92f-8c3e0cd46bd8 tempest-VolumesNegativeTest-2140190560 tempest-VolumesNegativeTest-2140190560-project] 10.222.0.27 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.012832 Oct 17 03:13:14.794683 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 112/234] 10.222.0.27 () {60 vars in 1156 bytes} [Mon Oct 17 03:13:14 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 03:13:14.802371 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-621a7130-8b29-4faa-9632-37068c291b38 tempest-VolumesNegativeTest-2140190560 tempest-VolumesNegativeTest-2140190560-project] Action: 'create', calling method: .version_select at 0x7fc701926160>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-57620899", "metadata": {"Type": "work"}}} {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:13:14.807389 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-621a7130-8b29-4faa-9632-37068c291b38 tempest-VolumesNegativeTest-2140190560 tempest-VolumesNegativeTest-2140190560-project] Request method failure captured: Oct 17 03:13:14.807389 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 17 03:13:14.807389 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Accept: application/json Oct 17 03:13:14.807389 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Accept-Encoding: identity Oct 17 03:13:14.807389 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Connection: close Oct 17 03:13:14.807389 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Content-Length: 117 Oct 17 03:13:14.807389 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Content-Type: application/json Oct 17 03:13:14.807389 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Host: 10.222.0.27 Oct 17 03:13:14.807389 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Openstack-System-Scope: None Oct 17 03:13:14.807389 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: User-Agent: python-urllib3/1.26.12 Oct 17 03:13:14.807389 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Auth-Token: gAAAAABjTMhKZPHRhDub_Cc-tTXFx8eEQqyp0gl-y-sjmlIs5SjRzO0LXUB51Kftqjr1g12poOWnnXGOQnRzyRPRMECkCoUxxCTWNTDUk0mZRlcQrBfY2_f_1scXTPHRRUKYt1RBMGjEqbKt8rkEojYcAF1t_ZWeX6PuOYk59dTQi3a6o_2gpLk Oct 17 03:13:14.807389 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Domain-Id: None Oct 17 03:13:14.807389 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Domain-Name: None Oct 17 03:13:14.807389 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Identity-Status: Confirmed Oct 17 03:13:14.807389 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Is-Admin-Project: True Oct 17 03:13:14.807389 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Project-Domain-Id: default Oct 17 03:13:14.807389 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Project-Domain-Name: Default Oct 17 03:13:14.807389 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Project-Id: ba1ddde60ab04563b3601961f3b36eea Oct 17 03:13:14.807389 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Project-Name: tempest-VolumesNegativeTest-2140190560 Oct 17 03:13:14.807389 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Role: member,reader Oct 17 03:13:14.807389 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Roles: member,reader Oct 17 03:13:14.810579 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ba1ddde60ab04563b3601961f3b36eea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ba1ddde60ab04563b3601961f3b36eea"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ba1ddde60ab04563b3601961f3b36eea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ba1ddde60ab04563b3601961f3b36eea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 17 03:13:14.810579 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Tenant: tempest-VolumesNegativeTest-2140190560 Oct 17 03:13:14.810579 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Tenant-Id: ba1ddde60ab04563b3601961f3b36eea Oct 17 03:13:14.810579 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Tenant-Name: tempest-VolumesNegativeTest-2140190560 Oct 17 03:13:14.810579 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-User: tempest-VolumesNegativeTest-2140190560-project Oct 17 03:13:14.810579 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-User-Domain-Id: default Oct 17 03:13:14.810579 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-User-Domain-Name: Default Oct 17 03:13:14.810579 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-User-Id: 5696f411c2d640f1a0e1d3309f6f422a Oct 17 03:13:14.810579 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-User-Name: tempest-VolumesNegativeTest-2140190560-project Oct 17 03:13:14.810579 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Oct 17 03:13:14.810579 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-57620899", "metadata": {"Type": "work"}}} Oct 17 03:13:14.810579 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: method: Oct 17 03:13:14.810579 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 17 03:13:14.811522 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-57620899', 'metadata': {'Type': 'work'}}}} Oct 17 03:13:14.811522 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 03:13:14.811522 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:13:14.811522 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 03:13:14.811522 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 03:13:14.811522 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 03:13:14.811522 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi raise error Oct 17 03:13:14.811522 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Oct 17 03:13:14.811522 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Oct 17 03:13:14.811522 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 17 03:13:14.811522 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 17 03:13:14.811522 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Oct 17 03:13:14.811522 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 17 03:13:14.811522 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi '' Oct 17 03:13:14.811522 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Oct 17 03:13:14.811522 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:13:14.811522 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Oct 17 03:13:14.811522 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:13:14.811522 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:13:14.811522 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:13:14.811522 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 03:13:14.811522 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 03:13:14.812683 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 03:13:14.812683 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 03:13:14.812683 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 03:13:14.812683 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 03:13:14.812683 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 17 03:13:14.812683 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 17 03:13:14.812683 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 03:13:14.812683 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 03:13:14.812683 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 03:13:14.812683 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 03:13:14.812683 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 17 03:13:14.812683 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Oct 17 03:13:14.812683 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:13:14.812683 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Oct 17 03:13:14.812683 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:13:14.812683 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:13:14.812683 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:13:14.812683 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 03:13:14.812683 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 03:13:14.813661 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 17 03:13:14.813661 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Oct 17 03:13:14.813661 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-621a7130-8b29-4faa-9632-37068c291b38 tempest-VolumesNegativeTest-2140190560 tempest-VolumesNegativeTest-2140190560-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=118886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 03:13:14.813661 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-621a7130-8b29-4faa-9632-37068c291b38 tempest-VolumesNegativeTest-2140190560 tempest-VolumesNegativeTest-2140190560-project] 10.222.0.27 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.011019 Oct 17 03:13:14.813661 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 123/235] 10.222.0.27 () {60 vars in 1156 bytes} [Mon Oct 17 03:13:14 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 03:13:14.817054 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-2672a43f-ee6a-453a-9af2-75c4236da851 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:13:14.818923 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-2672a43f-ee6a-453a-9af2-75c4236da851 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] [instance: c5bef4f0-63d6-4f68-aeec-a77348fd3921] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:13:14.820428 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-a9b5ec07-7b93-4f28-a802-c1d22d4b5dc0 tempest-VolumesNegativeTest-2140190560 tempest-VolumesNegativeTest-2140190560-project] Calling method '.version_select at 0x7fc701b44ee0>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:13:14.846634 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-2672a43f-ee6a-453a-9af2-75c4236da851 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:14.847382 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-2672a43f-ee6a-453a-9af2-75c4236da851 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:14.847821 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-2672a43f-ee6a-453a-9af2-75c4236da851 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:14.848525 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-2672a43f-ee6a-453a-9af2-75c4236da851 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:14.848975 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-2672a43f-ee6a-453a-9af2-75c4236da851 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:14.849654 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-2672a43f-ee6a-453a-9af2-75c4236da851 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:14.859084 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.wsgi [None req-a9b5ec07-7b93-4f28-a802-c1d22d4b5dc0 tempest-VolumesNegativeTest-2140190560 tempest-VolumesNegativeTest-2140190560-project] HTTP exception thrown: Volume tempest-invalid-1937752996 could not be found. Oct 17 03:13:14.861121 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-a9b5ec07-7b93-4f28-a802-c1d22d4b5dc0 tempest-VolumesNegativeTest-2140190560 tempest-VolumesNegativeTest-2140190560-project] Request method failure captured: Oct 17 03:13:14.861121 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1937752996 HTTP/1.1 Oct 17 03:13:14.861121 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Accept: application/json Oct 17 03:13:14.861121 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Accept-Encoding: identity Oct 17 03:13:14.861121 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Connection: close Oct 17 03:13:14.861121 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Content-Length: 0 Oct 17 03:13:14.861121 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Content-Type: application/json Oct 17 03:13:14.861121 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Host: 10.222.0.27 Oct 17 03:13:14.861121 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Openstack-System-Scope: None Oct 17 03:13:14.861121 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: User-Agent: python-urllib3/1.26.12 Oct 17 03:13:14.861121 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Auth-Token: gAAAAABjTMhKZPHRhDub_Cc-tTXFx8eEQqyp0gl-y-sjmlIs5SjRzO0LXUB51Kftqjr1g12poOWnnXGOQnRzyRPRMECkCoUxxCTWNTDUk0mZRlcQrBfY2_f_1scXTPHRRUKYt1RBMGjEqbKt8rkEojYcAF1t_ZWeX6PuOYk59dTQi3a6o_2gpLk Oct 17 03:13:14.861121 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Domain-Id: None Oct 17 03:13:14.861121 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Domain-Name: None Oct 17 03:13:14.861121 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Identity-Status: Confirmed Oct 17 03:13:14.861121 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Is-Admin-Project: True Oct 17 03:13:14.861121 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Project-Domain-Id: default Oct 17 03:13:14.861121 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Project-Domain-Name: Default Oct 17 03:13:14.861121 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Project-Id: ba1ddde60ab04563b3601961f3b36eea Oct 17 03:13:14.861121 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Project-Name: tempest-VolumesNegativeTest-2140190560 Oct 17 03:13:14.861121 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Role: member,reader Oct 17 03:13:14.861121 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Roles: member,reader Oct 17 03:13:14.862503 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ba1ddde60ab04563b3601961f3b36eea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ba1ddde60ab04563b3601961f3b36eea"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ba1ddde60ab04563b3601961f3b36eea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ba1ddde60ab04563b3601961f3b36eea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 17 03:13:14.862503 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Tenant: tempest-VolumesNegativeTest-2140190560 Oct 17 03:13:14.862503 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Tenant-Id: ba1ddde60ab04563b3601961f3b36eea Oct 17 03:13:14.862503 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Tenant-Name: tempest-VolumesNegativeTest-2140190560 Oct 17 03:13:14.862503 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-User: tempest-VolumesNegativeTest-2140190560-project Oct 17 03:13:14.862503 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-User-Domain-Id: default Oct 17 03:13:14.862503 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-User-Domain-Name: Default Oct 17 03:13:14.862503 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-User-Id: 5696f411c2d640f1a0e1d3309f6f422a Oct 17 03:13:14.862503 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-User-Name: tempest-VolumesNegativeTest-2140190560-project Oct 17 03:13:14.862503 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: method: Oct 17 03:13:14.862503 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: exception: Volume tempest-invalid-1937752996 could not be found. Oct 17 03:13:14.862503 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: action_args: {'id': 'tempest-invalid-1937752996'} Oct 17 03:13:14.862503 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 03:13:14.863450 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:13:14.863450 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 17 03:13:14.863450 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 17 03:13:14.863450 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 17 03:13:14.863450 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 17 03:13:14.863450 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 17 03:13:14.863450 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 17 03:13:14.863450 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 17 03:13:14.863450 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 17 03:13:14.863450 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 17 03:13:14.863450 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 17 03:13:14.863450 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 03:13:14.863450 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 03:13:14.863450 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 03:13:14.863450 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 03:13:14.863450 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1937752996 could not be found. (HTTP 404) (Request-ID: req-051453b7-ad97-45ef-a416-cb596d034cd7) Oct 17 03:13:14.863450 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Oct 17 03:13:14.863450 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:13:14.863450 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Oct 17 03:13:14.864664 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:13:14.864664 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 17 03:13:14.864664 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 17 03:13:14.864664 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 17 03:13:14.864664 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 17 03:13:14.864664 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 17 03:13:14.864664 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 17 03:13:14.864664 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 17 03:13:14.864664 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 17 03:13:14.864664 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 17 03:13:14.864664 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 17 03:13:14.864664 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 17 03:13:14.864664 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 17 03:13:14.864664 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 17 03:13:14.864664 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 17 03:13:14.864664 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 17 03:13:14.864664 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 17 03:13:14.864664 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 17 03:13:14.864664 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 17 03:13:14.866588 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 03:13:14.866588 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 03:13:14.866588 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 03:13:14.866588 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 03:13:14.866588 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1937752996 could not be found. Oct 17 03:13:14.866588 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Oct 17 03:13:14.866588 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:13:14.866588 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Oct 17 03:13:14.866588 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:13:14.866588 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:13:14.866588 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:13:14.866588 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 03:13:14.866588 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 03:13:14.866588 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 03:13:14.866588 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 03:13:14.866588 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 03:13:14.866588 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 03:13:14.866588 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 17 03:13:14.866588 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 03:13:14.866588 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1937752996 could not be found. Oct 17 03:13:14.867896 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Oct 17 03:13:14.867896 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:13:14.867896 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Oct 17 03:13:14.867896 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:13:14.867896 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:13:14.867896 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:13:14.867896 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 03:13:14.867896 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 03:13:14.867896 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1937752996 could not be found. Oct 17 03:13:14.867896 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Oct 17 03:13:14.867896 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-a9b5ec07-7b93-4f28-a802-c1d22d4b5dc0 tempest-VolumesNegativeTest-2140190560 tempest-VolumesNegativeTest-2140190560-project] Returning 404 to user: Volume tempest-invalid-1937752996 could not be found. {{(pid=118886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 03:13:14.867896 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-a9b5ec07-7b93-4f28-a802-c1d22d4b5dc0 tempest-VolumesNegativeTest-2140190560 tempest-VolumesNegativeTest-2140190560-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1937752996" status: 404 len: 99 microversion: 2.1 time: 0.047999 Oct 17 03:13:14.867896 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 124/236] 10.222.0.27 () {58 vars in 1218 bytes} [Mon Oct 17 03:13:14 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1937752996 => generated 99 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 17 03:13:14.878158 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-22c7c899-9b1b-40f5-b46d-ee837a1316dc tempest-VolumesNegativeTest-2140190560 tempest-VolumesNegativeTest-2140190560-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003951 Oct 17 03:13:14.878724 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 125/237] 10.222.0.27 () {58 vars in 1140 bytes} [Mon Oct 17 03:13:14 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 17 03:13:14.887162 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-5fbfe21b-2596-4e4a-ac95-7e0f8a2080f8 tempest-VolumesNegativeTest-2140190560 tempest-VolumesNegativeTest-2140190560-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003571 Oct 17 03:13:14.887739 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 126/238] 10.222.0.27 () {58 vars in 1137 bytes} [Mon Oct 17 03:13:14 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 17 03:13:14.895924 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-ec41a1fb-cd5f-46d4-b9c8-24e9487cfd4a tempest-VolumesNegativeTest-2140190560 tempest-VolumesNegativeTest-2140190560-project] Calling method '.version_select at 0x7fc7019264c0>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:13:14.925584 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.wsgi [None req-ec41a1fb-cd5f-46d4-b9c8-24e9487cfd4a tempest-VolumesNegativeTest-2140190560 tempest-VolumesNegativeTest-2140190560-project] HTTP exception thrown: Volume 5f5221d1-bcfd-42bc-9c09-7d67648fa3a3 could not be found. Oct 17 03:13:14.927526 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-ec41a1fb-cd5f-46d4-b9c8-24e9487cfd4a tempest-VolumesNegativeTest-2140190560 tempest-VolumesNegativeTest-2140190560-project] Request method failure captured: Oct 17 03:13:14.927526 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: request: DELETE /compute/v2.1/os-volumes/5f5221d1-bcfd-42bc-9c09-7d67648fa3a3 HTTP/1.1 Oct 17 03:13:14.927526 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Accept: application/json Oct 17 03:13:14.927526 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Accept-Encoding: identity Oct 17 03:13:14.927526 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Connection: close Oct 17 03:13:14.927526 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Content-Length: 0 Oct 17 03:13:14.927526 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Content-Type: application/json Oct 17 03:13:14.927526 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Host: 10.222.0.27 Oct 17 03:13:14.927526 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Openstack-System-Scope: None Oct 17 03:13:14.927526 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: User-Agent: python-urllib3/1.26.12 Oct 17 03:13:14.927526 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Auth-Token: gAAAAABjTMhKZPHRhDub_Cc-tTXFx8eEQqyp0gl-y-sjmlIs5SjRzO0LXUB51Kftqjr1g12poOWnnXGOQnRzyRPRMECkCoUxxCTWNTDUk0mZRlcQrBfY2_f_1scXTPHRRUKYt1RBMGjEqbKt8rkEojYcAF1t_ZWeX6PuOYk59dTQi3a6o_2gpLk Oct 17 03:13:14.927526 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Domain-Id: None Oct 17 03:13:14.927526 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Domain-Name: None Oct 17 03:13:14.927526 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Identity-Status: Confirmed Oct 17 03:13:14.927526 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Is-Admin-Project: True Oct 17 03:13:14.927526 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Project-Domain-Id: default Oct 17 03:13:14.927526 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Project-Domain-Name: Default Oct 17 03:13:14.927526 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Project-Id: ba1ddde60ab04563b3601961f3b36eea Oct 17 03:13:14.927526 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Project-Name: tempest-VolumesNegativeTest-2140190560 Oct 17 03:13:14.927526 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Role: member,reader Oct 17 03:13:14.927526 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Roles: member,reader Oct 17 03:13:14.928942 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ba1ddde60ab04563b3601961f3b36eea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ba1ddde60ab04563b3601961f3b36eea"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ba1ddde60ab04563b3601961f3b36eea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ba1ddde60ab04563b3601961f3b36eea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 17 03:13:14.928942 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Tenant: tempest-VolumesNegativeTest-2140190560 Oct 17 03:13:14.928942 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Tenant-Id: ba1ddde60ab04563b3601961f3b36eea Oct 17 03:13:14.928942 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Tenant-Name: tempest-VolumesNegativeTest-2140190560 Oct 17 03:13:14.928942 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-User: tempest-VolumesNegativeTest-2140190560-project Oct 17 03:13:14.928942 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-User-Domain-Id: default Oct 17 03:13:14.928942 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-User-Domain-Name: Default Oct 17 03:13:14.928942 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-User-Id: 5696f411c2d640f1a0e1d3309f6f422a Oct 17 03:13:14.928942 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-User-Name: tempest-VolumesNegativeTest-2140190560-project Oct 17 03:13:14.928942 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: method: Oct 17 03:13:14.928942 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: exception: Volume 5f5221d1-bcfd-42bc-9c09-7d67648fa3a3 could not be found. Oct 17 03:13:14.928942 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: action_args: {'id': '5f5221d1-bcfd-42bc-9c09-7d67648fa3a3'} Oct 17 03:13:14.928942 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 03:13:14.929761 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:13:14.929761 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 17 03:13:14.929761 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 17 03:13:14.929761 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 17 03:13:14.929761 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 17 03:13:14.929761 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 17 03:13:14.929761 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 17 03:13:14.929761 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 17 03:13:14.929761 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 17 03:13:14.929761 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 17 03:13:14.929761 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 17 03:13:14.929761 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 03:13:14.929761 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 03:13:14.929761 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 03:13:14.929761 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 03:13:14.929761 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5f5221d1-bcfd-42bc-9c09-7d67648fa3a3 could not be found. (HTTP 404) (Request-ID: req-8bb41a20-d6b1-4699-b3d0-441f503ec39d) Oct 17 03:13:14.929761 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Oct 17 03:13:14.929761 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:13:14.929761 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Oct 17 03:13:14.930778 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:13:14.930778 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 17 03:13:14.930778 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 17 03:13:14.930778 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 17 03:13:14.930778 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 17 03:13:14.930778 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 17 03:13:14.930778 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 17 03:13:14.930778 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 17 03:13:14.930778 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 17 03:13:14.930778 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 17 03:13:14.930778 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 17 03:13:14.930778 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 17 03:13:14.930778 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 17 03:13:14.930778 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 17 03:13:14.930778 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 17 03:13:14.930778 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 17 03:13:14.930778 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 17 03:13:14.930778 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 17 03:13:14.930778 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 17 03:13:14.931839 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 03:13:14.931839 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 03:13:14.931839 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 03:13:14.931839 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 03:13:14.931839 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5f5221d1-bcfd-42bc-9c09-7d67648fa3a3 could not be found. Oct 17 03:13:14.931839 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Oct 17 03:13:14.931839 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:13:14.931839 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Oct 17 03:13:14.931839 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:13:14.931839 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:13:14.931839 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:13:14.931839 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 03:13:14.931839 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 03:13:14.931839 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 03:13:14.931839 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 03:13:14.931839 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 03:13:14.931839 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 03:13:14.931839 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 17 03:13:14.931839 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 03:13:14.932804 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5f5221d1-bcfd-42bc-9c09-7d67648fa3a3 could not be found. Oct 17 03:13:14.932804 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Oct 17 03:13:14.932804 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:13:14.932804 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Oct 17 03:13:14.932804 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:13:14.932804 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:13:14.932804 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:13:14.932804 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 03:13:14.932804 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 03:13:14.932804 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5f5221d1-bcfd-42bc-9c09-7d67648fa3a3 could not be found. Oct 17 03:13:14.932804 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Oct 17 03:13:14.932804 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-ec41a1fb-cd5f-46d4-b9c8-24e9487cfd4a tempest-VolumesNegativeTest-2140190560 tempest-VolumesNegativeTest-2140190560-project] Returning 404 to user: Volume 5f5221d1-bcfd-42bc-9c09-7d67648fa3a3 could not be found. {{(pid=118886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 03:13:14.932804 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-ec41a1fb-cd5f-46d4-b9c8-24e9487cfd4a tempest-VolumesNegativeTest-2140190560 tempest-VolumesNegativeTest-2140190560-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/5f5221d1-bcfd-42bc-9c09-7d67648fa3a3" status: 404 len: 109 microversion: 2.1 time: 0.036777 Oct 17 03:13:14.932804 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 127/239] 10.222.0.27 () {58 vars in 1248 bytes} [Mon Oct 17 03:13:14 2022] DELETE /compute/v2.1/os-volumes/5f5221d1-bcfd-42bc-9c09-7d67648fa3a3 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 03:13:14.939544 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-cda600be-17d3-4b98-a235-ed2e5db9db78 tempest-VolumesNegativeTest-2140190560 tempest-VolumesNegativeTest-2140190560-project] Calling method '.version_select at 0x7fc70191bc10>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:13:14.969379 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.wsgi [None req-cda600be-17d3-4b98-a235-ed2e5db9db78 tempest-VolumesNegativeTest-2140190560 tempest-VolumesNegativeTest-2140190560-project] HTTP exception thrown: Volume ce347f7d-2bd9-4448-9f8a-734a1dd76795 could not be found. Oct 17 03:13:14.971347 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-cda600be-17d3-4b98-a235-ed2e5db9db78 tempest-VolumesNegativeTest-2140190560 tempest-VolumesNegativeTest-2140190560-project] Request method failure captured: Oct 17 03:13:14.971347 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: request: GET /compute/v2.1/os-volumes/ce347f7d-2bd9-4448-9f8a-734a1dd76795 HTTP/1.1 Oct 17 03:13:14.971347 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Accept: application/json Oct 17 03:13:14.971347 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Accept-Encoding: identity Oct 17 03:13:14.971347 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Connection: close Oct 17 03:13:14.971347 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Content-Length: 0 Oct 17 03:13:14.971347 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Content-Type: application/json Oct 17 03:13:14.971347 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Host: 10.222.0.27 Oct 17 03:13:14.971347 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Openstack-System-Scope: None Oct 17 03:13:14.971347 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: User-Agent: python-urllib3/1.26.12 Oct 17 03:13:14.971347 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Auth-Token: gAAAAABjTMhKZPHRhDub_Cc-tTXFx8eEQqyp0gl-y-sjmlIs5SjRzO0LXUB51Kftqjr1g12poOWnnXGOQnRzyRPRMECkCoUxxCTWNTDUk0mZRlcQrBfY2_f_1scXTPHRRUKYt1RBMGjEqbKt8rkEojYcAF1t_ZWeX6PuOYk59dTQi3a6o_2gpLk Oct 17 03:13:14.971347 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Domain-Id: None Oct 17 03:13:14.971347 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Domain-Name: None Oct 17 03:13:14.971347 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Identity-Status: Confirmed Oct 17 03:13:14.971347 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Is-Admin-Project: True Oct 17 03:13:14.971347 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Project-Domain-Id: default Oct 17 03:13:14.971347 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Project-Domain-Name: Default Oct 17 03:13:14.971347 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Project-Id: ba1ddde60ab04563b3601961f3b36eea Oct 17 03:13:14.971347 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Project-Name: tempest-VolumesNegativeTest-2140190560 Oct 17 03:13:14.971347 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Role: member,reader Oct 17 03:13:14.971347 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Roles: member,reader Oct 17 03:13:14.972510 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ba1ddde60ab04563b3601961f3b36eea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ba1ddde60ab04563b3601961f3b36eea"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ba1ddde60ab04563b3601961f3b36eea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ba1ddde60ab04563b3601961f3b36eea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 17 03:13:14.972510 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Tenant: tempest-VolumesNegativeTest-2140190560 Oct 17 03:13:14.972510 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Tenant-Id: ba1ddde60ab04563b3601961f3b36eea Oct 17 03:13:14.972510 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Tenant-Name: tempest-VolumesNegativeTest-2140190560 Oct 17 03:13:14.972510 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-User: tempest-VolumesNegativeTest-2140190560-project Oct 17 03:13:14.972510 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-User-Domain-Id: default Oct 17 03:13:14.972510 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-User-Domain-Name: Default Oct 17 03:13:14.972510 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-User-Id: 5696f411c2d640f1a0e1d3309f6f422a Oct 17 03:13:14.972510 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-User-Name: tempest-VolumesNegativeTest-2140190560-project Oct 17 03:13:14.972510 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: method: Oct 17 03:13:14.972510 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: exception: Volume ce347f7d-2bd9-4448-9f8a-734a1dd76795 could not be found. Oct 17 03:13:14.972510 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: action_args: {'id': 'ce347f7d-2bd9-4448-9f8a-734a1dd76795'} Oct 17 03:13:14.972510 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 03:13:14.973194 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:13:14.973194 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 17 03:13:14.973194 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 17 03:13:14.973194 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 17 03:13:14.973194 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 17 03:13:14.973194 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 17 03:13:14.973194 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 17 03:13:14.973194 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 17 03:13:14.973194 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 17 03:13:14.973194 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 17 03:13:14.973194 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 17 03:13:14.973194 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 03:13:14.973194 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 03:13:14.973194 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 03:13:14.973194 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 03:13:14.973194 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ce347f7d-2bd9-4448-9f8a-734a1dd76795 could not be found. (HTTP 404) (Request-ID: req-4dd1be27-adc0-4779-ad69-bb6512f3bbf4) Oct 17 03:13:14.973194 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Oct 17 03:13:14.973194 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:13:14.973194 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Oct 17 03:13:14.974191 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:13:14.974191 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 17 03:13:14.974191 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 17 03:13:14.974191 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 17 03:13:14.974191 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 17 03:13:14.974191 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 17 03:13:14.974191 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 17 03:13:14.974191 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 17 03:13:14.974191 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 17 03:13:14.974191 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 17 03:13:14.974191 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 17 03:13:14.974191 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 17 03:13:14.974191 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 17 03:13:14.974191 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 17 03:13:14.974191 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 17 03:13:14.974191 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 17 03:13:14.974191 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 17 03:13:14.974191 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 17 03:13:14.974191 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 17 03:13:14.976229 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 03:13:14.976229 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 03:13:14.976229 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 03:13:14.976229 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 03:13:14.976229 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ce347f7d-2bd9-4448-9f8a-734a1dd76795 could not be found. Oct 17 03:13:14.976229 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Oct 17 03:13:14.976229 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:13:14.976229 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Oct 17 03:13:14.976229 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:13:14.976229 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:13:14.976229 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:13:14.976229 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 03:13:14.976229 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 03:13:14.976229 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 03:13:14.976229 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 03:13:14.976229 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 03:13:14.976229 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 03:13:14.976229 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 17 03:13:14.976229 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 03:13:14.977253 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ce347f7d-2bd9-4448-9f8a-734a1dd76795 could not be found. Oct 17 03:13:14.977253 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Oct 17 03:13:14.977253 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:13:14.977253 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Oct 17 03:13:14.977253 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:13:14.977253 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:13:14.977253 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:13:14.977253 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 03:13:14.977253 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 03:13:14.977253 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ce347f7d-2bd9-4448-9f8a-734a1dd76795 could not be found. Oct 17 03:13:14.977253 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Oct 17 03:13:14.977253 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-cda600be-17d3-4b98-a235-ed2e5db9db78 tempest-VolumesNegativeTest-2140190560 tempest-VolumesNegativeTest-2140190560-project] Returning 404 to user: Volume ce347f7d-2bd9-4448-9f8a-734a1dd76795 could not be found. {{(pid=118886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 03:13:14.977253 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-cda600be-17d3-4b98-a235-ed2e5db9db78 tempest-VolumesNegativeTest-2140190560 tempest-VolumesNegativeTest-2140190560-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/ce347f7d-2bd9-4448-9f8a-734a1dd76795" status: 404 len: 109 microversion: 2.1 time: 0.037748 Oct 17 03:13:14.977253 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 128/240] 10.222.0.27 () {58 vars in 1245 bytes} [Mon Oct 17 03:13:14 2022] GET /compute/v2.1/os-volumes/ce347f7d-2bd9-4448-9f8a-734a1dd76795 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 03:13:14.986638 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-c48adb51-23b8-4821-9995-6de9bef3d72b tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:13:14.987332 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-c48adb51-23b8-4821-9995-6de9bef3d72b tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: f430d340-f7ff-4805-bd00-69eeaf33250d] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:13:14.993973 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-c48adb51-23b8-4821-9995-6de9bef3d72b tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:14.994533 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-c48adb51-23b8-4821-9995-6de9bef3d72b tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:14.995058 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-c48adb51-23b8-4821-9995-6de9bef3d72b tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:14.995840 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-c48adb51-23b8-4821-9995-6de9bef3d72b tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:14.996388 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-c48adb51-23b8-4821-9995-6de9bef3d72b tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:14.996872 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-c48adb51-23b8-4821-9995-6de9bef3d72b tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:15.143203 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-c48adb51-23b8-4821-9995-6de9bef3d72b tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1787a9ef7c44e28076aaa80c0152fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee21a91b84794e80b208fe72b7f1e010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:13:15.152308 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-c48adb51-23b8-4821-9995-6de9bef3d72b tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "GET /compute/v2.1/servers/f430d340-f7ff-4805-bd00-69eeaf33250d" status: 200 len: 1522 microversion: 2.1 time: 0.177797 Oct 17 03:13:15.153322 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 129/241] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:13:14 2022] GET /compute/v2.1/servers/f430d340-f7ff-4805-bd00-69eeaf33250d => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:13:15.157746 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-2672a43f-ee6a-453a-9af2-75c4236da851 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58fbb2d79954020aa1328ef6bf925e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b87c159313f74c77a95172124e82dc25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:13:15.166299 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-2672a43f-ee6a-453a-9af2-75c4236da851 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] 10.222.0.27 "GET /compute/v2.1/servers/c5bef4f0-63d6-4f68-aeec-a77348fd3921" status: 200 len: 1314 microversion: 2.1 time: 0.354938 Oct 17 03:13:15.166946 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 113/242] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:13:14 2022] GET /compute/v2.1/servers/c5bef4f0-63d6-4f68-aeec-a77348fd3921 => generated 1314 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:13:15.356454 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-94f44675-67c8-4d18-8cb4-a0ccff39e52b tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:13:15.358383 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-94f44675-67c8-4d18-8cb4-a0ccff39e52b tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] [instance: d7fc9f01-479b-43e9-9415-fe96b7140a47] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:13:15.371888 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-94f44675-67c8-4d18-8cb4-a0ccff39e52b tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:15.372383 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-94f44675-67c8-4d18-8cb4-a0ccff39e52b tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:15.372809 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-94f44675-67c8-4d18-8cb4-a0ccff39e52b tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:15.373498 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-94f44675-67c8-4d18-8cb4-a0ccff39e52b tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:15.374100 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-94f44675-67c8-4d18-8cb4-a0ccff39e52b tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:15.374527 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-94f44675-67c8-4d18-8cb4-a0ccff39e52b tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:15.561957 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-94f44675-67c8-4d18-8cb4-a0ccff39e52b tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc092c3cc0b4fbc9b420b8c7916132a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d285ecc0c5343b1b4001594013cd447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:13:15.590635 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-94f44675-67c8-4d18-8cb4-a0ccff39e52b tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] 10.222.0.27 "GET /compute/v2.1/servers/d7fc9f01-479b-43e9-9415-fe96b7140a47" status: 200 len: 1319 microversion: 2.1 time: 0.239075 Oct 17 03:13:15.591428 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 130/243] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:13:15 2022] GET /compute/v2.1/servers/d7fc9f01-479b-43e9-9415-fe96b7140a47 => generated 1319 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:13:15.610554 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [req-5c4c58ea-32f0-4211-98fc-949e68e6c512 req-b2f9c568-aed1-48cb-8bb6-36564658c05e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7fc9f01-479b-43e9-9415-fe96b7140a47", "tag": "366b0256-e4ee-408c-ae36-453ce05d015d"}]} {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:13:15.621872 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [req-5c4c58ea-32f0-4211-98fc-949e68e6c512 req-b2f9c568-aed1-48cb-8bb6-36564658c05e service nova] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:15.622351 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [req-5c4c58ea-32f0-4211-98fc-949e68e6c512 req-b2f9c568-aed1-48cb-8bb6-36564658c05e service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:15.622990 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [req-5c4c58ea-32f0-4211-98fc-949e68e6c512 req-b2f9c568-aed1-48cb-8bb6-36564658c05e service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:15.635204 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.compute.server_external_events [req-5c4c58ea-32f0-4211-98fc-949e68e6c512 req-b2f9c568-aed1-48cb-8bb6-36564658c05e service nova] Creating event network-changed:366b0256-e4ee-408c-ae36-453ce05d015d for instance d7fc9f01-479b-43e9-9415-fe96b7140a47 on hv-cinder-84697 Oct 17 03:13:15.640594 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [req-5c4c58ea-32f0-4211-98fc-949e68e6c512 req-b2f9c568-aed1-48cb-8bb6-36564658c05e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033643 Oct 17 03:13:15.642531 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 114/244] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 03:13:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:13:16.178585 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-c63c10dd-0321-4248-9c18-a3f29a610ef7 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:13:16.179887 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-c63c10dd-0321-4248-9c18-a3f29a610ef7 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: f430d340-f7ff-4805-bd00-69eeaf33250d] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:13:16.186331 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-c63c10dd-0321-4248-9c18-a3f29a610ef7 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:16.187053 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-c63c10dd-0321-4248-9c18-a3f29a610ef7 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:16.187473 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-c63c10dd-0321-4248-9c18-a3f29a610ef7 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:16.188314 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-c63c10dd-0321-4248-9c18-a3f29a610ef7 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:16.188917 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-c63c10dd-0321-4248-9c18-a3f29a610ef7 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:16.189462 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-c63c10dd-0321-4248-9c18-a3f29a610ef7 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:16.190809 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-3d8b7a0e-9088-4b0b-8e0a-09d38ccc6398 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:13:16.191737 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-3d8b7a0e-9088-4b0b-8e0a-09d38ccc6398 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] [instance: c5bef4f0-63d6-4f68-aeec-a77348fd3921] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:13:16.199640 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-3d8b7a0e-9088-4b0b-8e0a-09d38ccc6398 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:16.200357 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-3d8b7a0e-9088-4b0b-8e0a-09d38ccc6398 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:16.200901 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-3d8b7a0e-9088-4b0b-8e0a-09d38ccc6398 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:16.201813 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-3d8b7a0e-9088-4b0b-8e0a-09d38ccc6398 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:16.202501 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-3d8b7a0e-9088-4b0b-8e0a-09d38ccc6398 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:16.203197 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-3d8b7a0e-9088-4b0b-8e0a-09d38ccc6398 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:16.335586 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-c63c10dd-0321-4248-9c18-a3f29a610ef7 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1787a9ef7c44e28076aaa80c0152fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee21a91b84794e80b208fe72b7f1e010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:13:16.344213 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-c63c10dd-0321-4248-9c18-a3f29a610ef7 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "GET /compute/v2.1/servers/f430d340-f7ff-4805-bd00-69eeaf33250d" status: 200 len: 1522 microversion: 2.1 time: 0.170108 Oct 17 03:13:16.362293 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 131/245] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:13:16 2022] GET /compute/v2.1/servers/f430d340-f7ff-4805-bd00-69eeaf33250d => generated 1522 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:13:16.613995 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-4c49e592-393d-4642-808c-71340f9cba00 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:13:16.614978 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-4c49e592-393d-4642-808c-71340f9cba00 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] [instance: d7fc9f01-479b-43e9-9415-fe96b7140a47] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:13:16.622356 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-3d8b7a0e-9088-4b0b-8e0a-09d38ccc6398 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58fbb2d79954020aa1328ef6bf925e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b87c159313f74c77a95172124e82dc25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:13:16.627987 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-4c49e592-393d-4642-808c-71340f9cba00 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:16.628465 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-4c49e592-393d-4642-808c-71340f9cba00 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:16.629085 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-4c49e592-393d-4642-808c-71340f9cba00 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:16.629781 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-4c49e592-393d-4642-808c-71340f9cba00 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:16.630226 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-4c49e592-393d-4642-808c-71340f9cba00 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:16.630645 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-4c49e592-393d-4642-808c-71340f9cba00 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:16.631778 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-3d8b7a0e-9088-4b0b-8e0a-09d38ccc6398 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] 10.222.0.27 "GET /compute/v2.1/servers/c5bef4f0-63d6-4f68-aeec-a77348fd3921" status: 200 len: 1314 microversion: 2.1 time: 0.444580 Oct 17 03:13:16.632691 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 115/246] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:13:16 2022] GET /compute/v2.1/servers/c5bef4f0-63d6-4f68-aeec-a77348fd3921 => generated 1314 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:13:16.804777 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-4c49e592-393d-4642-808c-71340f9cba00 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc092c3cc0b4fbc9b420b8c7916132a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d285ecc0c5343b1b4001594013cd447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:13:16.808552 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG dbcounter [-] [118886] Writing DB stats nova_cell1:SELECT=100 {{(pid=118886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:13:16.813802 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-4c49e592-393d-4642-808c-71340f9cba00 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] 10.222.0.27 "GET /compute/v2.1/servers/d7fc9f01-479b-43e9-9415-fe96b7140a47" status: 200 len: 1319 microversion: 2.1 time: 0.204119 Oct 17 03:13:16.814559 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 132/247] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:13:16 2022] GET /compute/v2.1/servers/d7fc9f01-479b-43e9-9415-fe96b7140a47 => generated 1319 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:13:17.368856 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-c3c50eaf-b3b3-4edc-8513-64f654a164bc tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:13:17.370261 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-c3c50eaf-b3b3-4edc-8513-64f654a164bc tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: f430d340-f7ff-4805-bd00-69eeaf33250d] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:13:17.377195 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-c3c50eaf-b3b3-4edc-8513-64f654a164bc tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:17.377508 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-c3c50eaf-b3b3-4edc-8513-64f654a164bc tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:17.378014 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-c3c50eaf-b3b3-4edc-8513-64f654a164bc tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:17.378800 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-c3c50eaf-b3b3-4edc-8513-64f654a164bc tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:17.379354 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-c3c50eaf-b3b3-4edc-8513-64f654a164bc tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:17.379784 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-c3c50eaf-b3b3-4edc-8513-64f654a164bc tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:17.656056 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-d006e424-d15f-4cf9-a104-9d34c188b2cd tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:13:17.657332 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-d006e424-d15f-4cf9-a104-9d34c188b2cd tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] [instance: c5bef4f0-63d6-4f68-aeec-a77348fd3921] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:13:17.674287 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-d006e424-d15f-4cf9-a104-9d34c188b2cd tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:17.676944 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-d006e424-d15f-4cf9-a104-9d34c188b2cd tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:17.677387 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-d006e424-d15f-4cf9-a104-9d34c188b2cd tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:17.679018 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-d006e424-d15f-4cf9-a104-9d34c188b2cd tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:17.679837 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-d006e424-d15f-4cf9-a104-9d34c188b2cd tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:17.680243 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-d006e424-d15f-4cf9-a104-9d34c188b2cd tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:17.704579 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-c3c50eaf-b3b3-4edc-8513-64f654a164bc tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1787a9ef7c44e28076aaa80c0152fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee21a91b84794e80b208fe72b7f1e010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:13:17.715184 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-c3c50eaf-b3b3-4edc-8513-64f654a164bc tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "GET /compute/v2.1/servers/f430d340-f7ff-4805-bd00-69eeaf33250d" status: 200 len: 1522 microversion: 2.1 time: 0.350633 Oct 17 03:13:17.716664 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 116/248] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:13:17 2022] GET /compute/v2.1/servers/f430d340-f7ff-4805-bd00-69eeaf33250d => generated 1522 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:13:17.836720 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-8df1066f-24b7-4cf9-b841-3d74186d0e4e tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:13:17.837325 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-8df1066f-24b7-4cf9-b841-3d74186d0e4e tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] [instance: d7fc9f01-479b-43e9-9415-fe96b7140a47] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:13:17.845694 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-8df1066f-24b7-4cf9-b841-3d74186d0e4e tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:17.847333 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-8df1066f-24b7-4cf9-b841-3d74186d0e4e tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:17.847765 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-8df1066f-24b7-4cf9-b841-3d74186d0e4e tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:17.849499 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-8df1066f-24b7-4cf9-b841-3d74186d0e4e tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:17.853767 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-8df1066f-24b7-4cf9-b841-3d74186d0e4e tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:17.854232 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-8df1066f-24b7-4cf9-b841-3d74186d0e4e tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:17.858786 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-d006e424-d15f-4cf9-a104-9d34c188b2cd tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58fbb2d79954020aa1328ef6bf925e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b87c159313f74c77a95172124e82dc25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:13:17.874091 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-d006e424-d15f-4cf9-a104-9d34c188b2cd tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] 10.222.0.27 "GET /compute/v2.1/servers/c5bef4f0-63d6-4f68-aeec-a77348fd3921" status: 200 len: 1498 microversion: 2.1 time: 0.221762 Oct 17 03:13:17.879910 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 133/249] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:13:17 2022] GET /compute/v2.1/servers/c5bef4f0-63d6-4f68-aeec-a77348fd3921 => generated 1498 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:13:18.127275 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-8df1066f-24b7-4cf9-b841-3d74186d0e4e tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc092c3cc0b4fbc9b420b8c7916132a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d285ecc0c5343b1b4001594013cd447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:13:18.152075 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-8df1066f-24b7-4cf9-b841-3d74186d0e4e tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] 10.222.0.27 "GET /compute/v2.1/servers/d7fc9f01-479b-43e9-9415-fe96b7140a47" status: 200 len: 1319 microversion: 2.1 time: 0.316380 Oct 17 03:13:18.152677 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 117/250] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:13:17 2022] GET /compute/v2.1/servers/d7fc9f01-479b-43e9-9415-fe96b7140a47 => generated 1319 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:13:18.438625 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-38ec99e6-4547-4f06-aa46-64700dc0213d tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:13:18.439238 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-38ec99e6-4547-4f06-aa46-64700dc0213d tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] [instance: c5bef4f0-63d6-4f68-aeec-a77348fd3921] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:13:18.446905 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-38ec99e6-4547-4f06-aa46-64700dc0213d tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:18.447464 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-38ec99e6-4547-4f06-aa46-64700dc0213d tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:18.447970 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-38ec99e6-4547-4f06-aa46-64700dc0213d tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:18.448932 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-38ec99e6-4547-4f06-aa46-64700dc0213d tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:18.449882 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-38ec99e6-4547-4f06-aa46-64700dc0213d tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:18.450500 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-38ec99e6-4547-4f06-aa46-64700dc0213d tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:18.485716 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-38ec99e6-4547-4f06-aa46-64700dc0213d tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] [instance: c5bef4f0-63d6-4f68-aeec-a77348fd3921] Going to try to terminate instance {{(pid=118886) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 03:13:18.579444 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-38ec99e6-4547-4f06-aa46-64700dc0213d tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] 10.222.0.27 "DELETE /compute/v2.1/servers/c5bef4f0-63d6-4f68-aeec-a77348fd3921" status: 204 len: 0 microversion: 2.1 time: 0.144559 Oct 17 03:13:18.579983 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 134/251] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 03:13:18 2022] DELETE /compute/v2.1/servers/c5bef4f0-63d6-4f68-aeec-a77348fd3921 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 17 03:13:18.588190 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-08cf614f-d32c-4bd6-b115-3d813c268c42 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:13:18.588806 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-08cf614f-d32c-4bd6-b115-3d813c268c42 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] [instance: c5bef4f0-63d6-4f68-aeec-a77348fd3921] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:13:18.594893 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-08cf614f-d32c-4bd6-b115-3d813c268c42 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:18.595407 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-08cf614f-d32c-4bd6-b115-3d813c268c42 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:18.595837 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-08cf614f-d32c-4bd6-b115-3d813c268c42 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:18.596537 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-08cf614f-d32c-4bd6-b115-3d813c268c42 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:18.596991 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-08cf614f-d32c-4bd6-b115-3d813c268c42 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:18.597412 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-08cf614f-d32c-4bd6-b115-3d813c268c42 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:18.740930 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-bcc93cda-51b9-49f6-b0f6-2377f052b88b tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:13:18.742546 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-bcc93cda-51b9-49f6-b0f6-2377f052b88b tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: f430d340-f7ff-4805-bd00-69eeaf33250d] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:13:18.749635 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-08cf614f-d32c-4bd6-b115-3d813c268c42 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58fbb2d79954020aa1328ef6bf925e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b87c159313f74c77a95172124e82dc25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:13:18.751101 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-bcc93cda-51b9-49f6-b0f6-2377f052b88b tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:18.752180 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-bcc93cda-51b9-49f6-b0f6-2377f052b88b tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:18.752875 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-bcc93cda-51b9-49f6-b0f6-2377f052b88b tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:18.753807 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-bcc93cda-51b9-49f6-b0f6-2377f052b88b tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:18.754578 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-bcc93cda-51b9-49f6-b0f6-2377f052b88b tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:18.755164 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-bcc93cda-51b9-49f6-b0f6-2377f052b88b tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:18.759568 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-08cf614f-d32c-4bd6-b115-3d813c268c42 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] 10.222.0.27 "GET /compute/v2.1/servers/c5bef4f0-63d6-4f68-aeec-a77348fd3921" status: 200 len: 1504 microversion: 2.1 time: 0.175291 Oct 17 03:13:18.760508 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 118/252] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:13:18 2022] GET /compute/v2.1/servers/c5bef4f0-63d6-4f68-aeec-a77348fd3921 => generated 1504 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:13:19.014048 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-bcc93cda-51b9-49f6-b0f6-2377f052b88b tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1787a9ef7c44e28076aaa80c0152fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee21a91b84794e80b208fe72b7f1e010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:13:19.021720 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-bcc93cda-51b9-49f6-b0f6-2377f052b88b tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "GET /compute/v2.1/servers/f430d340-f7ff-4805-bd00-69eeaf33250d" status: 200 len: 1522 microversion: 2.1 time: 0.286758 Oct 17 03:13:19.022575 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 135/253] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:13:18 2022] GET /compute/v2.1/servers/f430d340-f7ff-4805-bd00-69eeaf33250d => generated 1522 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:13:19.176094 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-2b530bb9-a803-4bf4-b2cd-687a1fd44223 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:13:19.176733 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-2b530bb9-a803-4bf4-b2cd-687a1fd44223 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] [instance: d7fc9f01-479b-43e9-9415-fe96b7140a47] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:13:19.184207 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-2b530bb9-a803-4bf4-b2cd-687a1fd44223 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:19.185103 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-2b530bb9-a803-4bf4-b2cd-687a1fd44223 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:19.185588 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-2b530bb9-a803-4bf4-b2cd-687a1fd44223 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:19.186573 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-2b530bb9-a803-4bf4-b2cd-687a1fd44223 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:19.187059 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-2b530bb9-a803-4bf4-b2cd-687a1fd44223 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:19.187504 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-2b530bb9-a803-4bf4-b2cd-687a1fd44223 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:19.469453 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-2b530bb9-a803-4bf4-b2cd-687a1fd44223 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc092c3cc0b4fbc9b420b8c7916132a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d285ecc0c5343b1b4001594013cd447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:13:19.478437 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-2b530bb9-a803-4bf4-b2cd-687a1fd44223 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] 10.222.0.27 "GET /compute/v2.1/servers/d7fc9f01-479b-43e9-9415-fe96b7140a47" status: 200 len: 1319 microversion: 2.1 time: 0.306109 Oct 17 03:13:19.481151 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 119/254] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:13:19 2022] GET /compute/v2.1/servers/d7fc9f01-479b-43e9-9415-fe96b7140a47 => generated 1319 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:13:19.782956 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-8212b90f-1f69-41b7-b767-1c026cce0052 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:13:19.783464 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-8212b90f-1f69-41b7-b767-1c026cce0052 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] [instance: c5bef4f0-63d6-4f68-aeec-a77348fd3921] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:13:19.792009 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-8212b90f-1f69-41b7-b767-1c026cce0052 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:19.792497 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-8212b90f-1f69-41b7-b767-1c026cce0052 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:19.792939 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-8212b90f-1f69-41b7-b767-1c026cce0052 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:19.793630 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-8212b90f-1f69-41b7-b767-1c026cce0052 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:19.795330 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-8212b90f-1f69-41b7-b767-1c026cce0052 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:19.795935 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-8212b90f-1f69-41b7-b767-1c026cce0052 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:19.962215 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-8212b90f-1f69-41b7-b767-1c026cce0052 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58fbb2d79954020aa1328ef6bf925e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b87c159313f74c77a95172124e82dc25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:13:19.970286 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-8212b90f-1f69-41b7-b767-1c026cce0052 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] 10.222.0.27 "GET /compute/v2.1/servers/c5bef4f0-63d6-4f68-aeec-a77348fd3921" status: 200 len: 1504 microversion: 2.1 time: 0.191202 Oct 17 03:13:19.971109 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 136/255] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:13:19 2022] GET /compute/v2.1/servers/c5bef4f0-63d6-4f68-aeec-a77348fd3921 => generated 1504 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:13:20.046413 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-efdebb6b-a7ac-41cd-80da-ad46fde58f79 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:13:20.047725 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-efdebb6b-a7ac-41cd-80da-ad46fde58f79 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: f430d340-f7ff-4805-bd00-69eeaf33250d] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:13:20.054323 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-efdebb6b-a7ac-41cd-80da-ad46fde58f79 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:20.054803 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-efdebb6b-a7ac-41cd-80da-ad46fde58f79 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:20.055441 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-efdebb6b-a7ac-41cd-80da-ad46fde58f79 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:20.056291 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-efdebb6b-a7ac-41cd-80da-ad46fde58f79 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:20.056894 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-efdebb6b-a7ac-41cd-80da-ad46fde58f79 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:20.057472 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-efdebb6b-a7ac-41cd-80da-ad46fde58f79 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:20.280763 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-efdebb6b-a7ac-41cd-80da-ad46fde58f79 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1787a9ef7c44e28076aaa80c0152fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee21a91b84794e80b208fe72b7f1e010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:13:20.289151 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-efdebb6b-a7ac-41cd-80da-ad46fde58f79 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "GET /compute/v2.1/servers/f430d340-f7ff-4805-bd00-69eeaf33250d" status: 200 len: 1522 microversion: 2.1 time: 0.247056 Oct 17 03:13:20.290035 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 120/256] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:13:20 2022] GET /compute/v2.1/servers/f430d340-f7ff-4805-bd00-69eeaf33250d => generated 1522 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:13:20.508792 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-fd442771-9461-4be0-b069-77b6e19bc75d tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:13:20.509405 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-fd442771-9461-4be0-b069-77b6e19bc75d tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] [instance: d7fc9f01-479b-43e9-9415-fe96b7140a47] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:13:20.525195 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-fd442771-9461-4be0-b069-77b6e19bc75d tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:20.525685 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-fd442771-9461-4be0-b069-77b6e19bc75d tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:20.526117 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-fd442771-9461-4be0-b069-77b6e19bc75d tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:20.526806 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-fd442771-9461-4be0-b069-77b6e19bc75d tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:20.527340 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-fd442771-9461-4be0-b069-77b6e19bc75d tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:20.528030 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-fd442771-9461-4be0-b069-77b6e19bc75d tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:20.755046 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-fd442771-9461-4be0-b069-77b6e19bc75d tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc092c3cc0b4fbc9b420b8c7916132a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d285ecc0c5343b1b4001594013cd447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:13:20.763778 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-fd442771-9461-4be0-b069-77b6e19bc75d tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] 10.222.0.27 "GET /compute/v2.1/servers/d7fc9f01-479b-43e9-9415-fe96b7140a47" status: 200 len: 1319 microversion: 2.1 time: 0.262038 Oct 17 03:13:20.764577 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 137/257] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:13:20 2022] GET /compute/v2.1/servers/d7fc9f01-479b-43e9-9415-fe96b7140a47 => generated 1319 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:13:20.995617 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-93737a85-96b5-42b4-9a90-056f5b4ee6ec tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:13:20.996229 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-93737a85-96b5-42b4-9a90-056f5b4ee6ec tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] [instance: c5bef4f0-63d6-4f68-aeec-a77348fd3921] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:13:21.002903 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-93737a85-96b5-42b4-9a90-056f5b4ee6ec tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:21.003713 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-93737a85-96b5-42b4-9a90-056f5b4ee6ec tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:21.004165 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-93737a85-96b5-42b4-9a90-056f5b4ee6ec tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:21.004848 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-93737a85-96b5-42b4-9a90-056f5b4ee6ec tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:21.005327 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-93737a85-96b5-42b4-9a90-056f5b4ee6ec tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:21.005747 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-93737a85-96b5-42b4-9a90-056f5b4ee6ec tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:21.312487 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-1fb59c29-4e7b-460f-889f-a04a6773783d tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:13:21.313093 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-1fb59c29-4e7b-460f-889f-a04a6773783d tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: f430d340-f7ff-4805-bd00-69eeaf33250d] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:13:21.324946 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-1fb59c29-4e7b-460f-889f-a04a6773783d tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:21.325432 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-1fb59c29-4e7b-460f-889f-a04a6773783d tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:21.326342 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-93737a85-96b5-42b4-9a90-056f5b4ee6ec tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58fbb2d79954020aa1328ef6bf925e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b87c159313f74c77a95172124e82dc25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:13:21.329934 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-1fb59c29-4e7b-460f-889f-a04a6773783d tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:21.330670 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-1fb59c29-4e7b-460f-889f-a04a6773783d tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:21.331176 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-1fb59c29-4e7b-460f-889f-a04a6773783d tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:21.331603 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-1fb59c29-4e7b-460f-889f-a04a6773783d tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:21.344781 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-93737a85-96b5-42b4-9a90-056f5b4ee6ec tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] 10.222.0.27 "GET /compute/v2.1/servers/c5bef4f0-63d6-4f68-aeec-a77348fd3921" status: 200 len: 1504 microversion: 2.1 time: 0.354291 Oct 17 03:13:21.345401 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 121/258] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:13:20 2022] GET /compute/v2.1/servers/c5bef4f0-63d6-4f68-aeec-a77348fd3921 => generated 1504 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:13:21.513417 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-1fb59c29-4e7b-460f-889f-a04a6773783d tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1787a9ef7c44e28076aaa80c0152fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee21a91b84794e80b208fe72b7f1e010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:13:21.523068 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-1fb59c29-4e7b-460f-889f-a04a6773783d tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "GET /compute/v2.1/servers/f430d340-f7ff-4805-bd00-69eeaf33250d" status: 200 len: 1522 microversion: 2.1 time: 0.213408 Oct 17 03:13:21.523790 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 138/259] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:13:21 2022] GET /compute/v2.1/servers/f430d340-f7ff-4805-bd00-69eeaf33250d => generated 1522 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:13:21.668803 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [req-af8e8ad5-0e71-42b4-af0a-3f62ab52fc58 req-9240ee9e-fb78-4818-a5c0-8f67ced8112b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5bef4f0-63d6-4f68-aeec-a77348fd3921", "name": "network-vif-deleted", "tag": "7fb9edbd-1a95-4c9b-bafa-7879c03c7674"}]} {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:13:21.681591 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [req-af8e8ad5-0e71-42b4-af0a-3f62ab52fc58 req-9240ee9e-fb78-4818-a5c0-8f67ced8112b service nova] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:21.682279 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [req-af8e8ad5-0e71-42b4-af0a-3f62ab52fc58 req-9240ee9e-fb78-4818-a5c0-8f67ced8112b service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:21.682855 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [req-af8e8ad5-0e71-42b4-af0a-3f62ab52fc58 req-9240ee9e-fb78-4818-a5c0-8f67ced8112b service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:21.695785 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.compute.server_external_events [req-af8e8ad5-0e71-42b4-af0a-3f62ab52fc58 req-9240ee9e-fb78-4818-a5c0-8f67ced8112b service nova] Creating event network-vif-deleted:7fb9edbd-1a95-4c9b-bafa-7879c03c7674 for instance c5bef4f0-63d6-4f68-aeec-a77348fd3921 on hv-cinder-84697 Oct 17 03:13:21.700990 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [req-af8e8ad5-0e71-42b4-af0a-3f62ab52fc58 req-9240ee9e-fb78-4818-a5c0-8f67ced8112b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035661 Oct 17 03:13:21.701964 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 122/260] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 03:13:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:13:21.787986 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-970f8819-99fc-4f64-92aa-70d3925b0ab7 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:13:21.788626 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-970f8819-99fc-4f64-92aa-70d3925b0ab7 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] [instance: d7fc9f01-479b-43e9-9415-fe96b7140a47] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:13:21.790694 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG dbcounter [-] [118886] Writing DB stats nova_cell0:SELECT=4 {{(pid=118886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:13:21.796236 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-970f8819-99fc-4f64-92aa-70d3925b0ab7 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:21.796920 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-970f8819-99fc-4f64-92aa-70d3925b0ab7 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:21.797359 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-970f8819-99fc-4f64-92aa-70d3925b0ab7 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:21.798047 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-970f8819-99fc-4f64-92aa-70d3925b0ab7 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:21.798659 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-970f8819-99fc-4f64-92aa-70d3925b0ab7 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:21.799120 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-970f8819-99fc-4f64-92aa-70d3925b0ab7 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:21.804069 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG dbcounter [-] [118886] Writing DB stats nova_cell0:SELECT=12 {{(pid=118886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:13:22.085032 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-970f8819-99fc-4f64-92aa-70d3925b0ab7 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc092c3cc0b4fbc9b420b8c7916132a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d285ecc0c5343b1b4001594013cd447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:13:22.092806 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-970f8819-99fc-4f64-92aa-70d3925b0ab7 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] 10.222.0.27 "GET /compute/v2.1/servers/d7fc9f01-479b-43e9-9415-fe96b7140a47" status: 200 len: 1319 microversion: 2.1 time: 0.309751 Oct 17 03:13:22.093383 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 139/261] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:13:21 2022] GET /compute/v2.1/servers/d7fc9f01-479b-43e9-9415-fe96b7140a47 => generated 1319 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:13:22.373773 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-47261486-f8b3-4596-83fd-26f16e002b6d tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:13:22.373773 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-47261486-f8b3-4596-83fd-26f16e002b6d tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] [instance: c5bef4f0-63d6-4f68-aeec-a77348fd3921] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:13:22.373773 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG dbcounter [-] [118887] Writing DB stats nova_cell0:SELECT=4 {{(pid=118887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:13:22.380959 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-47261486-f8b3-4596-83fd-26f16e002b6d tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:22.381630 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-47261486-f8b3-4596-83fd-26f16e002b6d tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:22.382367 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-47261486-f8b3-4596-83fd-26f16e002b6d tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:22.383609 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-47261486-f8b3-4596-83fd-26f16e002b6d tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:22.384077 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-47261486-f8b3-4596-83fd-26f16e002b6d tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:22.384510 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-47261486-f8b3-4596-83fd-26f16e002b6d tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:22.461043 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-47261486-f8b3-4596-83fd-26f16e002b6d tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58fbb2d79954020aa1328ef6bf925e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b87c159313f74c77a95172124e82dc25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:13:22.476268 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-47261486-f8b3-4596-83fd-26f16e002b6d tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] 10.222.0.27 "GET /compute/v2.1/servers/c5bef4f0-63d6-4f68-aeec-a77348fd3921" status: 200 len: 1462 microversion: 2.1 time: 0.108418 Oct 17 03:13:22.478060 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 123/262] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:13:22 2022] GET /compute/v2.1/servers/c5bef4f0-63d6-4f68-aeec-a77348fd3921 => generated 1462 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:13:22.547459 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-59937c49-e921-4c31-9508-cab87fc68d4c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:13:22.550561 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-59937c49-e921-4c31-9508-cab87fc68d4c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: f430d340-f7ff-4805-bd00-69eeaf33250d] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:13:22.556274 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-59937c49-e921-4c31-9508-cab87fc68d4c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:22.556808 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-59937c49-e921-4c31-9508-cab87fc68d4c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:22.557277 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-59937c49-e921-4c31-9508-cab87fc68d4c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:22.558023 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-59937c49-e921-4c31-9508-cab87fc68d4c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:22.558709 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-59937c49-e921-4c31-9508-cab87fc68d4c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:22.559190 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-59937c49-e921-4c31-9508-cab87fc68d4c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:22.628810 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [req-99a0e5c1-e4df-4bed-a23a-55aa101ea28c req-323debff-8c6c-43d0-bdf9-15b89d677dbb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7fc9f01-479b-43e9-9415-fe96b7140a47", "name": "network-vif-plugged", "status": "completed", "tag": "366b0256-e4ee-408c-ae36-453ce05d015d"}]} {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:13:22.657361 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [req-99a0e5c1-e4df-4bed-a23a-55aa101ea28c req-323debff-8c6c-43d0-bdf9-15b89d677dbb service nova] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:22.660771 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [req-99a0e5c1-e4df-4bed-a23a-55aa101ea28c req-323debff-8c6c-43d0-bdf9-15b89d677dbb service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:22.661780 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [req-99a0e5c1-e4df-4bed-a23a-55aa101ea28c req-323debff-8c6c-43d0-bdf9-15b89d677dbb service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:22.694210 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.compute.server_external_events [req-99a0e5c1-e4df-4bed-a23a-55aa101ea28c req-323debff-8c6c-43d0-bdf9-15b89d677dbb service nova] Creating event network-vif-plugged:366b0256-e4ee-408c-ae36-453ce05d015d for instance d7fc9f01-479b-43e9-9415-fe96b7140a47 on hv-cinder-84697 Oct 17 03:13:22.701629 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [req-99a0e5c1-e4df-4bed-a23a-55aa101ea28c req-323debff-8c6c-43d0-bdf9-15b89d677dbb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077467 Oct 17 03:13:22.702741 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 124/263] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 03:13:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 03:13:22.815671 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-59937c49-e921-4c31-9508-cab87fc68d4c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1787a9ef7c44e28076aaa80c0152fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee21a91b84794e80b208fe72b7f1e010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:13:22.826436 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-59937c49-e921-4c31-9508-cab87fc68d4c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "GET /compute/v2.1/servers/f430d340-f7ff-4805-bd00-69eeaf33250d" status: 200 len: 1522 microversion: 2.1 time: 0.282674 Oct 17 03:13:22.827711 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 140/264] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:13:22 2022] GET /compute/v2.1/servers/f430d340-f7ff-4805-bd00-69eeaf33250d => generated 1522 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:13:23.117897 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-73b7e98a-c0a0-4558-beee-41a5c97dbc39 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:13:23.118588 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-73b7e98a-c0a0-4558-beee-41a5c97dbc39 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] [instance: d7fc9f01-479b-43e9-9415-fe96b7140a47] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:13:23.125069 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-73b7e98a-c0a0-4558-beee-41a5c97dbc39 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:23.125965 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-73b7e98a-c0a0-4558-beee-41a5c97dbc39 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:23.126446 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-73b7e98a-c0a0-4558-beee-41a5c97dbc39 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:23.127299 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-73b7e98a-c0a0-4558-beee-41a5c97dbc39 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:23.127867 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-73b7e98a-c0a0-4558-beee-41a5c97dbc39 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:23.128584 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-73b7e98a-c0a0-4558-beee-41a5c97dbc39 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:23.259517 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-73b7e98a-c0a0-4558-beee-41a5c97dbc39 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc092c3cc0b4fbc9b420b8c7916132a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d285ecc0c5343b1b4001594013cd447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:13:23.266992 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-73b7e98a-c0a0-4558-beee-41a5c97dbc39 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] 10.222.0.27 "GET /compute/v2.1/servers/d7fc9f01-479b-43e9-9415-fe96b7140a47" status: 200 len: 1319 microversion: 2.1 time: 0.154295 Oct 17 03:13:23.267552 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 125/265] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:13:23 2022] GET /compute/v2.1/servers/d7fc9f01-479b-43e9-9415-fe96b7140a47 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:13:23.500915 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-ee5cae04-2789-4002-bf26-1322a7070d21 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:13:23.501547 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-ee5cae04-2789-4002-bf26-1322a7070d21 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] [instance: c5bef4f0-63d6-4f68-aeec-a77348fd3921] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:13:23.507669 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-ee5cae04-2789-4002-bf26-1322a7070d21 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:23.508151 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-ee5cae04-2789-4002-bf26-1322a7070d21 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:23.508579 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-ee5cae04-2789-4002-bf26-1322a7070d21 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:23.509276 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-ee5cae04-2789-4002-bf26-1322a7070d21 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:23.509720 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-ee5cae04-2789-4002-bf26-1322a7070d21 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:23.510135 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-ee5cae04-2789-4002-bf26-1322a7070d21 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:23.541449 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-ee5cae04-2789-4002-bf26-1322a7070d21 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:23.542192 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-ee5cae04-2789-4002-bf26-1322a7070d21 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:23.542934 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-ee5cae04-2789-4002-bf26-1322a7070d21 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:23.543378 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.objects.instance [None req-ee5cae04-2789-4002-bf26-1322a7070d21 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lazy-loading 'fault' on Instance uuid c5bef4f0-63d6-4f68-aeec-a77348fd3921 {{(pid=118886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 03:13:23.604858 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-ee5cae04-2789-4002-bf26-1322a7070d21 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58fbb2d79954020aa1328ef6bf925e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b87c159313f74c77a95172124e82dc25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:13:23.612858 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-ee5cae04-2789-4002-bf26-1322a7070d21 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] 10.222.0.27 "GET /compute/v2.1/servers/c5bef4f0-63d6-4f68-aeec-a77348fd3921" status: 200 len: 1304 microversion: 2.1 time: 0.115903 Oct 17 03:13:23.613450 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 141/266] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:13:23 2022] GET /compute/v2.1/servers/c5bef4f0-63d6-4f68-aeec-a77348fd3921 => generated 1304 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:13:23.854197 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-9a02523a-6ac5-4ed7-b798-080fac274b7c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:13:23.854808 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-9a02523a-6ac5-4ed7-b798-080fac274b7c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: f430d340-f7ff-4805-bd00-69eeaf33250d] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:13:23.861020 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-9a02523a-6ac5-4ed7-b798-080fac274b7c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:23.861554 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-9a02523a-6ac5-4ed7-b798-080fac274b7c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:23.862002 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-9a02523a-6ac5-4ed7-b798-080fac274b7c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:23.862694 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-9a02523a-6ac5-4ed7-b798-080fac274b7c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:23.863174 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-9a02523a-6ac5-4ed7-b798-080fac274b7c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:23.863601 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-9a02523a-6ac5-4ed7-b798-080fac274b7c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:24.003885 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-9a02523a-6ac5-4ed7-b798-080fac274b7c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1787a9ef7c44e28076aaa80c0152fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee21a91b84794e80b208fe72b7f1e010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:13:24.012096 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-9a02523a-6ac5-4ed7-b798-080fac274b7c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "GET /compute/v2.1/servers/f430d340-f7ff-4805-bd00-69eeaf33250d" status: 200 len: 1522 microversion: 2.1 time: 0.162533 Oct 17 03:13:24.012660 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 126/267] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:13:23 2022] GET /compute/v2.1/servers/f430d340-f7ff-4805-bd00-69eeaf33250d => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:13:24.289686 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-fbfc803f-1509-480b-a58d-723d27b74835 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:13:24.290275 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-fbfc803f-1509-480b-a58d-723d27b74835 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] [instance: d7fc9f01-479b-43e9-9415-fe96b7140a47] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:13:24.296651 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-fbfc803f-1509-480b-a58d-723d27b74835 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:24.297204 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-fbfc803f-1509-480b-a58d-723d27b74835 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:24.297637 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-fbfc803f-1509-480b-a58d-723d27b74835 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:24.298411 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-fbfc803f-1509-480b-a58d-723d27b74835 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:24.298946 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-fbfc803f-1509-480b-a58d-723d27b74835 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:24.299402 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-fbfc803f-1509-480b-a58d-723d27b74835 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:24.432366 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-fbfc803f-1509-480b-a58d-723d27b74835 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc092c3cc0b4fbc9b420b8c7916132a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d285ecc0c5343b1b4001594013cd447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:13:24.440859 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-fbfc803f-1509-480b-a58d-723d27b74835 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] 10.222.0.27 "GET /compute/v2.1/servers/d7fc9f01-479b-43e9-9415-fe96b7140a47" status: 200 len: 1319 microversion: 2.1 time: 0.155160 Oct 17 03:13:24.441427 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 142/268] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:13:24 2022] GET /compute/v2.1/servers/d7fc9f01-479b-43e9-9415-fe96b7140a47 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:13:24.638168 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-041ff977-3ed6-4c6d-8bad-f62b20ed9a63 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:13:24.638840 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-041ff977-3ed6-4c6d-8bad-f62b20ed9a63 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] [instance: c5bef4f0-63d6-4f68-aeec-a77348fd3921] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:13:24.644947 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-041ff977-3ed6-4c6d-8bad-f62b20ed9a63 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:24.645427 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-041ff977-3ed6-4c6d-8bad-f62b20ed9a63 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:24.645855 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-041ff977-3ed6-4c6d-8bad-f62b20ed9a63 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:24.647360 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-041ff977-3ed6-4c6d-8bad-f62b20ed9a63 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:24.647806 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-041ff977-3ed6-4c6d-8bad-f62b20ed9a63 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:24.648380 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-041ff977-3ed6-4c6d-8bad-f62b20ed9a63 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:24.679342 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-041ff977-3ed6-4c6d-8bad-f62b20ed9a63 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:24.679829 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-041ff977-3ed6-4c6d-8bad-f62b20ed9a63 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:24.680262 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-041ff977-3ed6-4c6d-8bad-f62b20ed9a63 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:24.680714 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.objects.instance [None req-041ff977-3ed6-4c6d-8bad-f62b20ed9a63 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lazy-loading 'fault' on Instance uuid c5bef4f0-63d6-4f68-aeec-a77348fd3921 {{(pid=118887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 03:13:24.729626 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-041ff977-3ed6-4c6d-8bad-f62b20ed9a63 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58fbb2d79954020aa1328ef6bf925e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b87c159313f74c77a95172124e82dc25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:13:24.737326 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-041ff977-3ed6-4c6d-8bad-f62b20ed9a63 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] 10.222.0.27 "GET /compute/v2.1/servers/c5bef4f0-63d6-4f68-aeec-a77348fd3921" status: 200 len: 1304 microversion: 2.1 time: 0.103515 Oct 17 03:13:24.737937 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 127/269] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:13:24 2022] GET /compute/v2.1/servers/c5bef4f0-63d6-4f68-aeec-a77348fd3921 => generated 1304 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:13:25.052939 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-4923773b-d03e-4f17-b6b5-4f7e22c06b8a tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:13:25.054096 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-4923773b-d03e-4f17-b6b5-4f7e22c06b8a tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: f430d340-f7ff-4805-bd00-69eeaf33250d] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:13:25.065419 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-4923773b-d03e-4f17-b6b5-4f7e22c06b8a tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:25.066014 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-4923773b-d03e-4f17-b6b5-4f7e22c06b8a tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:25.066332 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-4923773b-d03e-4f17-b6b5-4f7e22c06b8a tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:25.067071 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-4923773b-d03e-4f17-b6b5-4f7e22c06b8a tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:25.067717 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-4923773b-d03e-4f17-b6b5-4f7e22c06b8a tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:25.068139 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-4923773b-d03e-4f17-b6b5-4f7e22c06b8a tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:25.209485 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-4923773b-d03e-4f17-b6b5-4f7e22c06b8a tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1787a9ef7c44e28076aaa80c0152fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee21a91b84794e80b208fe72b7f1e010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:13:25.220715 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-4923773b-d03e-4f17-b6b5-4f7e22c06b8a tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "GET /compute/v2.1/servers/f430d340-f7ff-4805-bd00-69eeaf33250d" status: 200 len: 1502 microversion: 2.1 time: 0.189083 Oct 17 03:13:25.221511 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 143/270] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:13:25 2022] GET /compute/v2.1/servers/f430d340-f7ff-4805-bd00-69eeaf33250d => generated 1502 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:13:25.245819 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-489ba99d-1a55-4a0e-88d1-46f742e43e4b tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:13:25.246443 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-489ba99d-1a55-4a0e-88d1-46f742e43e4b tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: 90f2768b-8259-439c-af06-7eff342615ee] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:13:25.252395 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-489ba99d-1a55-4a0e-88d1-46f742e43e4b tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:25.252880 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-489ba99d-1a55-4a0e-88d1-46f742e43e4b tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:25.253308 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-489ba99d-1a55-4a0e-88d1-46f742e43e4b tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:25.254004 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-489ba99d-1a55-4a0e-88d1-46f742e43e4b tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:25.254454 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-489ba99d-1a55-4a0e-88d1-46f742e43e4b tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:25.254893 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-489ba99d-1a55-4a0e-88d1-46f742e43e4b tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:25.466326 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-873ae67b-fef9-4806-aa32-04aea31c4d71 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:13:25.467154 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-873ae67b-fef9-4806-aa32-04aea31c4d71 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] [instance: d7fc9f01-479b-43e9-9415-fe96b7140a47] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:13:25.482148 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-873ae67b-fef9-4806-aa32-04aea31c4d71 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:25.483760 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-873ae67b-fef9-4806-aa32-04aea31c4d71 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:25.484316 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-489ba99d-1a55-4a0e-88d1-46f742e43e4b tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1787a9ef7c44e28076aaa80c0152fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee21a91b84794e80b208fe72b7f1e010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:13:25.485040 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-873ae67b-fef9-4806-aa32-04aea31c4d71 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:25.485764 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-873ae67b-fef9-4806-aa32-04aea31c4d71 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:25.486221 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-873ae67b-fef9-4806-aa32-04aea31c4d71 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:25.486649 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-873ae67b-fef9-4806-aa32-04aea31c4d71 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:25.502448 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-489ba99d-1a55-4a0e-88d1-46f742e43e4b tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "GET /compute/v2.1/servers/90f2768b-8259-439c-af06-7eff342615ee" status: 200 len: 1516 microversion: 2.1 time: 0.260339 Oct 17 03:13:25.503666 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 128/271] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:13:25 2022] GET /compute/v2.1/servers/90f2768b-8259-439c-af06-7eff342615ee => generated 1516 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:13:25.717943 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-873ae67b-fef9-4806-aa32-04aea31c4d71 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc092c3cc0b4fbc9b420b8c7916132a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d285ecc0c5343b1b4001594013cd447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:13:25.733023 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-873ae67b-fef9-4806-aa32-04aea31c4d71 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] 10.222.0.27 "GET /compute/v2.1/servers/d7fc9f01-479b-43e9-9415-fe96b7140a47" status: 200 len: 1508 microversion: 2.1 time: 0.271667 Oct 17 03:13:25.748404 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 144/272] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:13:25 2022] GET /compute/v2.1/servers/d7fc9f01-479b-43e9-9415-fe96b7140a47 => generated 1508 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:13:25.766162 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-0def65c5-dffa-4e8b-951d-0e06d4b07deb tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:13:25.771595 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-0def65c5-dffa-4e8b-951d-0e06d4b07deb tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] [instance: c5bef4f0-63d6-4f68-aeec-a77348fd3921] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:13:25.787873 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-0def65c5-dffa-4e8b-951d-0e06d4b07deb tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:25.788972 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-0def65c5-dffa-4e8b-951d-0e06d4b07deb tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:25.791481 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-0def65c5-dffa-4e8b-951d-0e06d4b07deb tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:25.792872 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-0def65c5-dffa-4e8b-951d-0e06d4b07deb tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:25.796325 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-0def65c5-dffa-4e8b-951d-0e06d4b07deb tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:25.797597 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-0def65c5-dffa-4e8b-951d-0e06d4b07deb tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:25.842523 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-0def65c5-dffa-4e8b-951d-0e06d4b07deb tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:25.843160 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-0def65c5-dffa-4e8b-951d-0e06d4b07deb tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:25.843567 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-0def65c5-dffa-4e8b-951d-0e06d4b07deb tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:25.844065 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.objects.instance [None req-0def65c5-dffa-4e8b-951d-0e06d4b07deb tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lazy-loading 'fault' on Instance uuid c5bef4f0-63d6-4f68-aeec-a77348fd3921 {{(pid=118887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 03:13:25.921997 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-0def65c5-dffa-4e8b-951d-0e06d4b07deb tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58fbb2d79954020aa1328ef6bf925e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b87c159313f74c77a95172124e82dc25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:13:25.933189 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG dbcounter [-] [118887] Writing DB stats nova_cell1:SELECT=100 {{(pid=118887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:13:25.939334 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-0def65c5-dffa-4e8b-951d-0e06d4b07deb tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] 10.222.0.27 "GET /compute/v2.1/servers/c5bef4f0-63d6-4f68-aeec-a77348fd3921" status: 200 len: 1304 microversion: 2.1 time: 0.180107 Oct 17 03:13:25.941244 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 129/273] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:13:25 2022] GET /compute/v2.1/servers/c5bef4f0-63d6-4f68-aeec-a77348fd3921 => generated 1304 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:13:26.967296 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-a218ee14-1488-43a9-b543-9c25075f3a2d tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:13:26.968714 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-a218ee14-1488-43a9-b543-9c25075f3a2d tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] [instance: c5bef4f0-63d6-4f68-aeec-a77348fd3921] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:13:26.980543 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-a218ee14-1488-43a9-b543-9c25075f3a2d tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:26.981022 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-a218ee14-1488-43a9-b543-9c25075f3a2d tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:26.981442 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-a218ee14-1488-43a9-b543-9c25075f3a2d tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:26.982163 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-a218ee14-1488-43a9-b543-9c25075f3a2d tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:26.982697 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-a218ee14-1488-43a9-b543-9c25075f3a2d tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:26.983039 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-a218ee14-1488-43a9-b543-9c25075f3a2d tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:27.000813 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.wsgi [None req-a218ee14-1488-43a9-b543-9c25075f3a2d tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] HTTP exception thrown: Instance c5bef4f0-63d6-4f68-aeec-a77348fd3921 could not be found. Oct 17 03:13:27.004308 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-a218ee14-1488-43a9-b543-9c25075f3a2d tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Request method failure captured: Oct 17 03:13:27.004308 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: request: GET /compute/v2.1/servers/c5bef4f0-63d6-4f68-aeec-a77348fd3921 HTTP/1.1 Oct 17 03:13:27.004308 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Accept: application/json Oct 17 03:13:27.004308 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Accept-Encoding: identity Oct 17 03:13:27.004308 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Connection: close Oct 17 03:13:27.004308 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Content-Length: 0 Oct 17 03:13:27.004308 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Content-Type: application/json Oct 17 03:13:27.004308 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Host: 10.222.0.27 Oct 17 03:13:27.004308 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Openstack-System-Scope: None Oct 17 03:13:27.004308 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: User-Agent: python-urllib3/1.26.12 Oct 17 03:13:27.004308 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Auth-Token: gAAAAABjTMg-nnIXIahbZMQx43GIrXYuxuoBJmPXPDG8dyv2na9TS8ndT3wZ-hCyWsILnvDa2e9yaN-pTDl01K-KfhHZMIxcmF7tCpVVjyeXUIrJV0Rkvw-cY-1XFWsp7gR_L2zYdYC90YsNk4yLZtq6llhWPwWkYjyGHQPCn0KDuefdIECI_ts Oct 17 03:13:27.004308 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Domain-Id: None Oct 17 03:13:27.004308 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Domain-Name: None Oct 17 03:13:27.004308 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Identity-Status: Confirmed Oct 17 03:13:27.004308 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Is-Admin-Project: True Oct 17 03:13:27.004308 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Project-Domain-Id: default Oct 17 03:13:27.004308 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Project-Domain-Name: Default Oct 17 03:13:27.004308 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Project-Id: b87c159313f74c77a95172124e82dc25 Oct 17 03:13:27.004308 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Project-Name: tempest-VolumesActionsTest-1421221816 Oct 17 03:13:27.004308 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Role: member,reader Oct 17 03:13:27.004308 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Roles: member,reader Oct 17 03:13:27.005513 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b87c159313f74c77a95172124e82dc25"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b87c159313f74c77a95172124e82dc25"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b87c159313f74c77a95172124e82dc25"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b87c159313f74c77a95172124e82dc25"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 17 03:13:27.005513 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Tenant: tempest-VolumesActionsTest-1421221816 Oct 17 03:13:27.005513 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Tenant-Id: b87c159313f74c77a95172124e82dc25 Oct 17 03:13:27.005513 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Tenant-Name: tempest-VolumesActionsTest-1421221816 Oct 17 03:13:27.005513 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-User: tempest-VolumesActionsTest-1421221816-project Oct 17 03:13:27.005513 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-User-Domain-Id: default Oct 17 03:13:27.005513 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-User-Domain-Name: Default Oct 17 03:13:27.005513 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-User-Id: c58fbb2d79954020aa1328ef6bf925e4 Oct 17 03:13:27.005513 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-User-Name: tempest-VolumesActionsTest-1421221816-project Oct 17 03:13:27.005513 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: method: > Oct 17 03:13:27.005513 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: exception: Instance c5bef4f0-63d6-4f68-aeec-a77348fd3921 could not be found. Oct 17 03:13:27.005513 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: action_args: {'id': 'c5bef4f0-63d6-4f68-aeec-a77348fd3921'} Oct 17 03:13:27.007042 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 03:13:27.007042 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:13:27.007042 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 03:13:27.007042 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 03:13:27.007042 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 03:13:27.007042 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 03:13:27.007042 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 03:13:27.007042 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 03:13:27.007042 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 03:13:27.007042 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 03:13:27.007042 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5bef4f0-63d6-4f68-aeec-a77348fd3921 could not be found. Oct 17 03:13:27.007042 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Oct 17 03:13:27.007042 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:13:27.007042 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Oct 17 03:13:27.007042 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:13:27.007042 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:13:27.007042 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:13:27.007042 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 03:13:27.007042 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 03:13:27.007042 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 03:13:27.008187 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 03:13:27.008187 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 03:13:27.008187 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 03:13:27.008187 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 03:13:27.008187 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 03:13:27.008187 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 03:13:27.008187 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 03:13:27.008187 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5bef4f0-63d6-4f68-aeec-a77348fd3921 could not be found. Oct 17 03:13:27.008187 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Oct 17 03:13:27.008187 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:13:27.008187 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Oct 17 03:13:27.008187 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:13:27.008187 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:13:27.008187 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:13:27.008187 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 03:13:27.008187 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 03:13:27.008187 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5bef4f0-63d6-4f68-aeec-a77348fd3921 could not be found. Oct 17 03:13:27.008187 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Oct 17 03:13:27.010688 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-a218ee14-1488-43a9-b543-9c25075f3a2d tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Returning 404 to user: Instance c5bef4f0-63d6-4f68-aeec-a77348fd3921 could not be found. {{(pid=118886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 03:13:27.011857 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-a218ee14-1488-43a9-b543-9c25075f3a2d tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] 10.222.0.27 "GET /compute/v2.1/servers/c5bef4f0-63d6-4f68-aeec-a77348fd3921" status: 404 len: 111 microversion: 2.1 time: 0.049585 Oct 17 03:13:27.012471 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 145/274] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:13:26 2022] GET /compute/v2.1/servers/c5bef4f0-63d6-4f68-aeec-a77348fd3921 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 03:13:27.156898 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-c37a4f78-29ae-4c2c-a4a6-daff35217251 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:13:27.160822 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-c37a4f78-29ae-4c2c-a4a6-daff35217251 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: 90f2768b-8259-439c-af06-7eff342615ee] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:13:27.168469 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-c37a4f78-29ae-4c2c-a4a6-daff35217251 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:27.169167 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-c37a4f78-29ae-4c2c-a4a6-daff35217251 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:27.169789 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-c37a4f78-29ae-4c2c-a4a6-daff35217251 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:27.170760 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-c37a4f78-29ae-4c2c-a4a6-daff35217251 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:27.171567 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-c37a4f78-29ae-4c2c-a4a6-daff35217251 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:27.172881 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-c37a4f78-29ae-4c2c-a4a6-daff35217251 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:27.206000 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.objects.instance [None req-c37a4f78-29ae-4c2c-a4a6-daff35217251 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lazy-loading 'flavor' on Instance uuid 90f2768b-8259-439c-af06-7eff342615ee {{(pid=118887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 03:13:27.243722 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-34841441-5196-4249-897d-af2812871dc1 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1485647705", "imageRef": "e6d41914-f1bc-4b72-9113-1a69b3d0d83b", "flavorRef": "452", "networks": [{"uuid": "facc8931-b1bd-467e-90f2-4b5fa4eb484d"}]}} {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:13:27.346073 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.network.neutron [None req-34841441-5196-4249-897d-af2812871dc1 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] validate_networks() for [('facc8931-b1bd-467e-90f2-4b5fa4eb484d', None, None, None, None, None)] {{(pid=118886) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 03:13:27.367457 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-c37a4f78-29ae-4c2c-a4a6-daff35217251 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "POST /compute/v2.1/servers/90f2768b-8259-439c-af06-7eff342615ee/action" status: 200 len: 32 microversion: 2.1 time: 0.215341 Oct 17 03:13:27.368076 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 130/275] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 03:13:27 2022] POST /compute/v2.1/servers/90f2768b-8259-439c-af06-7eff342615ee/action => generated 32 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 03:13:27.379837 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-b39fac5f-a849-4a23-95d4-c01fea3c0b67 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:13:27.380771 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-b39fac5f-a849-4a23-95d4-c01fea3c0b67 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: 90f2768b-8259-439c-af06-7eff342615ee] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:13:27.391963 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-b39fac5f-a849-4a23-95d4-c01fea3c0b67 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:27.392630 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-b39fac5f-a849-4a23-95d4-c01fea3c0b67 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:27.393610 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-b39fac5f-a849-4a23-95d4-c01fea3c0b67 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:27.394561 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-b39fac5f-a849-4a23-95d4-c01fea3c0b67 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:27.395329 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-b39fac5f-a849-4a23-95d4-c01fea3c0b67 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:27.395989 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-b39fac5f-a849-4a23-95d4-c01fea3c0b67 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:27.627854 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-b39fac5f-a849-4a23-95d4-c01fea3c0b67 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1787a9ef7c44e28076aaa80c0152fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee21a91b84794e80b208fe72b7f1e010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:13:27.640651 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-b39fac5f-a849-4a23-95d4-c01fea3c0b67 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "GET /compute/v2.1/servers/90f2768b-8259-439c-af06-7eff342615ee" status: 200 len: 1522 microversion: 2.1 time: 0.266166 Oct 17 03:13:27.641376 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 131/276] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:13:27 2022] GET /compute/v2.1/servers/90f2768b-8259-439c-af06-7eff342615ee => generated 1522 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:13:27.885675 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.virt.hardware [None req-34841441-5196-4249-897d-af2812871dc1 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Flavor limits 0:0:0 {{(pid=118886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 03:13:27.885960 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.virt.hardware [None req-34841441-5196-4249-897d-af2812871dc1 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Image limits 0:0:0 {{(pid=118886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 03:13:27.886875 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.virt.hardware [None req-34841441-5196-4249-897d-af2812871dc1 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Flavor pref 0:0:0 {{(pid=118886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 03:13:27.887351 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.virt.hardware [None req-34841441-5196-4249-897d-af2812871dc1 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Image pref 0:0:0 {{(pid=118886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 03:13:27.887935 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.virt.hardware [None req-34841441-5196-4249-897d-af2812871dc1 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 03:13:27.898081 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-34841441-5196-4249-897d-af2812871dc1 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:27.898568 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-34841441-5196-4249-897d-af2812871dc1 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:27.899043 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-34841441-5196-4249-897d-af2812871dc1 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:27.899778 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-34841441-5196-4249-897d-af2812871dc1 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:27.900229 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-34841441-5196-4249-897d-af2812871dc1 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:27.900652 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-34841441-5196-4249-897d-af2812871dc1 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:27.921745 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.quota [None req-34841441-5196-4249-897d-af2812871dc1 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Getting quotas for project b87c159313f74c77a95172124e82dc25. Resources: {'instances', 'cores', 'ram'} {{(pid=118886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 03:13:27.925842 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.quota [None req-34841441-5196-4249-897d-af2812871dc1 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Getting quotas for user c58fbb2d79954020aa1328ef6bf925e4 and project b87c159313f74c77a95172124e82dc25. Resources: {'instances', 'cores', 'ram'} {{(pid=118886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 03:13:27.940846 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-34841441-5196-4249-897d-af2812871dc1 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Going to run 1 instances... {{(pid=118886) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 03:13:27.943884 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-34841441-5196-4249-897d-af2812871dc1 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] [instance: 9f85118d-4e33-45e1-9dc6-ee755b6d9df3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e6d41914-f1bc-4b72-9113-1a69b3d0d83b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 03:13:28.007800 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-34841441-5196-4249-897d-af2812871dc1 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.767547 Oct 17 03:13:28.010436 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 146/277] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 03:13:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 772 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 17 03:13:28.024771 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-92e1b3fa-8d7b-42d2-915d-ffcf57d4b5ce tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:13:28.025586 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-92e1b3fa-8d7b-42d2-915d-ffcf57d4b5ce tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] [instance: 9f85118d-4e33-45e1-9dc6-ee755b6d9df3] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:13:28.092764 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-92e1b3fa-8d7b-42d2-915d-ffcf57d4b5ce tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58fbb2d79954020aa1328ef6bf925e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b87c159313f74c77a95172124e82dc25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:13:28.104535 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-92e1b3fa-8d7b-42d2-915d-ffcf57d4b5ce tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] 10.222.0.27 "GET /compute/v2.1/servers/9f85118d-4e33-45e1-9dc6-ee755b6d9df3" status: 200 len: 1214 microversion: 2.1 time: 0.083512 Oct 17 03:13:28.105240 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 132/278] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:13:28 2022] GET /compute/v2.1/servers/9f85118d-4e33-45e1-9dc6-ee755b6d9df3 => generated 1214 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:13:28.676055 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-8c63d141-753d-490f-a788-92ed5b8d6e5d tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:13:28.676767 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-8c63d141-753d-490f-a788-92ed5b8d6e5d tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: 90f2768b-8259-439c-af06-7eff342615ee] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:13:28.686540 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-8c63d141-753d-490f-a788-92ed5b8d6e5d tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:28.687060 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-8c63d141-753d-490f-a788-92ed5b8d6e5d tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:28.687542 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-8c63d141-753d-490f-a788-92ed5b8d6e5d tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:28.688208 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-8c63d141-753d-490f-a788-92ed5b8d6e5d tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:28.688682 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-8c63d141-753d-490f-a788-92ed5b8d6e5d tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:28.689092 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-8c63d141-753d-490f-a788-92ed5b8d6e5d tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:28.830818 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-8c63d141-753d-490f-a788-92ed5b8d6e5d tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1787a9ef7c44e28076aaa80c0152fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee21a91b84794e80b208fe72b7f1e010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:13:28.839480 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-8c63d141-753d-490f-a788-92ed5b8d6e5d tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "GET /compute/v2.1/servers/90f2768b-8259-439c-af06-7eff342615ee" status: 200 len: 1522 microversion: 2.1 time: 0.167928 Oct 17 03:13:28.840105 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 147/279] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:13:28 2022] GET /compute/v2.1/servers/90f2768b-8259-439c-af06-7eff342615ee => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:13:29.134045 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-41452c82-8195-47eb-b1a6-de736be283f2 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:13:29.135340 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-41452c82-8195-47eb-b1a6-de736be283f2 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] [instance: 9f85118d-4e33-45e1-9dc6-ee755b6d9df3] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:13:29.142274 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-41452c82-8195-47eb-b1a6-de736be283f2 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:29.142987 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-41452c82-8195-47eb-b1a6-de736be283f2 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:29.143422 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-41452c82-8195-47eb-b1a6-de736be283f2 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:29.144159 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-41452c82-8195-47eb-b1a6-de736be283f2 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:29.144604 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-41452c82-8195-47eb-b1a6-de736be283f2 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:29.145216 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-41452c82-8195-47eb-b1a6-de736be283f2 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:29.229448 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-41452c82-8195-47eb-b1a6-de736be283f2 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58fbb2d79954020aa1328ef6bf925e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b87c159313f74c77a95172124e82dc25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:13:29.238804 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-41452c82-8195-47eb-b1a6-de736be283f2 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] 10.222.0.27 "GET /compute/v2.1/servers/9f85118d-4e33-45e1-9dc6-ee755b6d9df3" status: 200 len: 1266 microversion: 2.1 time: 0.108940 Oct 17 03:13:29.239382 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 133/280] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:13:29 2022] GET /compute/v2.1/servers/9f85118d-4e33-45e1-9dc6-ee755b6d9df3 => generated 1266 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:13:29.863898 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-48880e63-8568-4cf2-b166-3ce3f3cf93e6 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:13:29.864551 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-48880e63-8568-4cf2-b166-3ce3f3cf93e6 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: 90f2768b-8259-439c-af06-7eff342615ee] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:13:29.873770 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-48880e63-8568-4cf2-b166-3ce3f3cf93e6 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:29.874261 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-48880e63-8568-4cf2-b166-3ce3f3cf93e6 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:29.874700 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-48880e63-8568-4cf2-b166-3ce3f3cf93e6 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:29.875435 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-48880e63-8568-4cf2-b166-3ce3f3cf93e6 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:29.875888 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-48880e63-8568-4cf2-b166-3ce3f3cf93e6 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:29.876349 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-48880e63-8568-4cf2-b166-3ce3f3cf93e6 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:30.079787 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-48880e63-8568-4cf2-b166-3ce3f3cf93e6 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1787a9ef7c44e28076aaa80c0152fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee21a91b84794e80b208fe72b7f1e010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:13:30.083228 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG dbcounter [-] [118886] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:13:30.090237 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-48880e63-8568-4cf2-b166-3ce3f3cf93e6 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "GET /compute/v2.1/servers/90f2768b-8259-439c-af06-7eff342615ee" status: 200 len: 1522 microversion: 2.1 time: 0.230987 Oct 17 03:13:30.102585 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 148/281] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:13:29 2022] GET /compute/v2.1/servers/90f2768b-8259-439c-af06-7eff342615ee => generated 1522 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:13:30.262674 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-9d533eb9-8122-4ea1-9615-b8a9b0fbeaf7 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:13:30.264099 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-9d533eb9-8122-4ea1-9615-b8a9b0fbeaf7 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] [instance: 9f85118d-4e33-45e1-9dc6-ee755b6d9df3] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:13:30.270463 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-9d533eb9-8122-4ea1-9615-b8a9b0fbeaf7 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:30.271211 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-9d533eb9-8122-4ea1-9615-b8a9b0fbeaf7 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:30.272458 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-9d533eb9-8122-4ea1-9615-b8a9b0fbeaf7 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:30.273674 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-9d533eb9-8122-4ea1-9615-b8a9b0fbeaf7 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:30.274404 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-9d533eb9-8122-4ea1-9615-b8a9b0fbeaf7 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:30.275144 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-9d533eb9-8122-4ea1-9615-b8a9b0fbeaf7 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:30.678039 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-9d533eb9-8122-4ea1-9615-b8a9b0fbeaf7 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58fbb2d79954020aa1328ef6bf925e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b87c159313f74c77a95172124e82dc25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:13:30.685943 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-9d533eb9-8122-4ea1-9615-b8a9b0fbeaf7 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] 10.222.0.27 "GET /compute/v2.1/servers/9f85118d-4e33-45e1-9dc6-ee755b6d9df3" status: 200 len: 1314 microversion: 2.1 time: 0.427893 Oct 17 03:13:30.686819 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 134/282] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:13:30 2022] GET /compute/v2.1/servers/9f85118d-4e33-45e1-9dc6-ee755b6d9df3 => generated 1314 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:13:31.115718 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-435c5036-32a8-4068-ae88-5367211df923 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:13:31.116334 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-435c5036-32a8-4068-ae88-5367211df923 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: 90f2768b-8259-439c-af06-7eff342615ee] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:13:31.123883 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-435c5036-32a8-4068-ae88-5367211df923 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:31.124372 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-435c5036-32a8-4068-ae88-5367211df923 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:31.124835 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-435c5036-32a8-4068-ae88-5367211df923 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:31.125694 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-435c5036-32a8-4068-ae88-5367211df923 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:31.126303 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-435c5036-32a8-4068-ae88-5367211df923 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:31.126732 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-435c5036-32a8-4068-ae88-5367211df923 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:31.263748 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [req-7cf88f90-6a14-4bd0-9e2f-b3bb44b8a33b req-11001e25-0f04-4bab-b598-86156e801f12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f85118d-4e33-45e1-9dc6-ee755b6d9df3", "tag": "a058c34f-585b-4f34-a8f2-ddf3be0cb87e"}]} {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:13:31.283603 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [req-7cf88f90-6a14-4bd0-9e2f-b3bb44b8a33b req-11001e25-0f04-4bab-b598-86156e801f12 service nova] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:31.284301 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [req-7cf88f90-6a14-4bd0-9e2f-b3bb44b8a33b req-11001e25-0f04-4bab-b598-86156e801f12 service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:31.284925 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [req-7cf88f90-6a14-4bd0-9e2f-b3bb44b8a33b req-11001e25-0f04-4bab-b598-86156e801f12 service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:31.303291 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.compute.server_external_events [req-7cf88f90-6a14-4bd0-9e2f-b3bb44b8a33b req-11001e25-0f04-4bab-b598-86156e801f12 service nova] Creating event network-changed:a058c34f-585b-4f34-a8f2-ddf3be0cb87e for instance 9f85118d-4e33-45e1-9dc6-ee755b6d9df3 on hv-cinder-84697 Oct 17 03:13:31.306064 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-435c5036-32a8-4068-ae88-5367211df923 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1787a9ef7c44e28076aaa80c0152fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee21a91b84794e80b208fe72b7f1e010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:13:31.309062 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [req-7cf88f90-6a14-4bd0-9e2f-b3bb44b8a33b req-11001e25-0f04-4bab-b598-86156e801f12 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049431 Oct 17 03:13:31.310669 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 135/283] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 03:13:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:13:31.320125 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-435c5036-32a8-4068-ae88-5367211df923 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "GET /compute/v2.1/servers/90f2768b-8259-439c-af06-7eff342615ee" status: 200 len: 1522 microversion: 2.1 time: 0.207468 Oct 17 03:13:31.331634 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 149/284] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:13:31 2022] GET /compute/v2.1/servers/90f2768b-8259-439c-af06-7eff342615ee => generated 1522 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:13:31.714193 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-ed453407-0725-41e4-b2f5-d0ebbdfb42ce tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:13:31.714900 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-ed453407-0725-41e4-b2f5-d0ebbdfb42ce tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] [instance: 9f85118d-4e33-45e1-9dc6-ee755b6d9df3] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:13:31.722962 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-ed453407-0725-41e4-b2f5-d0ebbdfb42ce tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:31.723725 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-ed453407-0725-41e4-b2f5-d0ebbdfb42ce tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:31.724386 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-ed453407-0725-41e4-b2f5-d0ebbdfb42ce tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:31.726372 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-ed453407-0725-41e4-b2f5-d0ebbdfb42ce tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:31.727075 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-ed453407-0725-41e4-b2f5-d0ebbdfb42ce tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:31.727565 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-ed453407-0725-41e4-b2f5-d0ebbdfb42ce tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:31.917411 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-ed453407-0725-41e4-b2f5-d0ebbdfb42ce tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58fbb2d79954020aa1328ef6bf925e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b87c159313f74c77a95172124e82dc25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:13:31.926546 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-ed453407-0725-41e4-b2f5-d0ebbdfb42ce tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] 10.222.0.27 "GET /compute/v2.1/servers/9f85118d-4e33-45e1-9dc6-ee755b6d9df3" status: 200 len: 1314 microversion: 2.1 time: 0.216689 Oct 17 03:13:31.927236 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 136/285] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:13:31 2022] GET /compute/v2.1/servers/9f85118d-4e33-45e1-9dc6-ee755b6d9df3 => generated 1314 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:13:32.344513 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-c64b03ef-53cc-488a-ae3e-618cdedbffe3 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:13:32.345907 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-c64b03ef-53cc-488a-ae3e-618cdedbffe3 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: 90f2768b-8259-439c-af06-7eff342615ee] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:13:32.352476 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-c64b03ef-53cc-488a-ae3e-618cdedbffe3 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:32.352966 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-c64b03ef-53cc-488a-ae3e-618cdedbffe3 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:32.353458 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-c64b03ef-53cc-488a-ae3e-618cdedbffe3 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:32.354239 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-c64b03ef-53cc-488a-ae3e-618cdedbffe3 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:32.354661 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-c64b03ef-53cc-488a-ae3e-618cdedbffe3 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:32.355260 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-c64b03ef-53cc-488a-ae3e-618cdedbffe3 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:32.548277 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-c64b03ef-53cc-488a-ae3e-618cdedbffe3 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1787a9ef7c44e28076aaa80c0152fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee21a91b84794e80b208fe72b7f1e010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:13:32.557685 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-c64b03ef-53cc-488a-ae3e-618cdedbffe3 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "GET /compute/v2.1/servers/90f2768b-8259-439c-af06-7eff342615ee" status: 200 len: 1522 microversion: 2.1 time: 0.217999 Oct 17 03:13:32.558737 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 150/286] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:13:32 2022] GET /compute/v2.1/servers/90f2768b-8259-439c-af06-7eff342615ee => generated 1522 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:13:32.949505 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-7387d068-046a-4eaf-9d9d-d161b5218930 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:13:32.950093 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-7387d068-046a-4eaf-9d9d-d161b5218930 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] [instance: 9f85118d-4e33-45e1-9dc6-ee755b6d9df3] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:13:32.956534 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-7387d068-046a-4eaf-9d9d-d161b5218930 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:32.957113 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-7387d068-046a-4eaf-9d9d-d161b5218930 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:32.957458 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-7387d068-046a-4eaf-9d9d-d161b5218930 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:32.958169 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-7387d068-046a-4eaf-9d9d-d161b5218930 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:32.958620 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-7387d068-046a-4eaf-9d9d-d161b5218930 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:32.959158 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-7387d068-046a-4eaf-9d9d-d161b5218930 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:33.104966 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-7387d068-046a-4eaf-9d9d-d161b5218930 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58fbb2d79954020aa1328ef6bf925e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b87c159313f74c77a95172124e82dc25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:13:33.112956 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-7387d068-046a-4eaf-9d9d-d161b5218930 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] 10.222.0.27 "GET /compute/v2.1/servers/9f85118d-4e33-45e1-9dc6-ee755b6d9df3" status: 200 len: 1314 microversion: 2.1 time: 0.167091 Oct 17 03:13:33.113526 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 137/287] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:13:32 2022] GET /compute/v2.1/servers/9f85118d-4e33-45e1-9dc6-ee755b6d9df3 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:13:33.581992 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-b54c0cfe-1bba-463e-b64a-4318e394bd1d tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:13:33.583332 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-b54c0cfe-1bba-463e-b64a-4318e394bd1d tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: 90f2768b-8259-439c-af06-7eff342615ee] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:13:33.593538 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-b54c0cfe-1bba-463e-b64a-4318e394bd1d tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:33.594446 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-b54c0cfe-1bba-463e-b64a-4318e394bd1d tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:33.595066 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-b54c0cfe-1bba-463e-b64a-4318e394bd1d tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:33.595940 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-b54c0cfe-1bba-463e-b64a-4318e394bd1d tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:33.596538 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-b54c0cfe-1bba-463e-b64a-4318e394bd1d tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:33.597103 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-b54c0cfe-1bba-463e-b64a-4318e394bd1d tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:33.735664 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-b54c0cfe-1bba-463e-b64a-4318e394bd1d tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1787a9ef7c44e28076aaa80c0152fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee21a91b84794e80b208fe72b7f1e010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:13:33.744369 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-b54c0cfe-1bba-463e-b64a-4318e394bd1d tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "GET /compute/v2.1/servers/90f2768b-8259-439c-af06-7eff342615ee" status: 200 len: 1522 microversion: 2.1 time: 0.166796 Oct 17 03:13:33.744941 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 151/288] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:13:33 2022] GET /compute/v2.1/servers/90f2768b-8259-439c-af06-7eff342615ee => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:13:34.137368 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-7a2dd015-27e3-4df8-b143-cfc9aa99493a tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:13:34.137971 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-7a2dd015-27e3-4df8-b143-cfc9aa99493a tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] [instance: 9f85118d-4e33-45e1-9dc6-ee755b6d9df3] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:13:34.143792 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-7a2dd015-27e3-4df8-b143-cfc9aa99493a tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:34.144274 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-7a2dd015-27e3-4df8-b143-cfc9aa99493a tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:34.144704 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-7a2dd015-27e3-4df8-b143-cfc9aa99493a tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:34.145395 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-7a2dd015-27e3-4df8-b143-cfc9aa99493a tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:34.145927 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-7a2dd015-27e3-4df8-b143-cfc9aa99493a tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:34.146253 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-7a2dd015-27e3-4df8-b143-cfc9aa99493a tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:34.286441 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-7a2dd015-27e3-4df8-b143-cfc9aa99493a tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58fbb2d79954020aa1328ef6bf925e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b87c159313f74c77a95172124e82dc25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:13:34.294898 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-7a2dd015-27e3-4df8-b143-cfc9aa99493a tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] 10.222.0.27 "GET /compute/v2.1/servers/9f85118d-4e33-45e1-9dc6-ee755b6d9df3" status: 200 len: 1314 microversion: 2.1 time: 0.161176 Oct 17 03:13:34.295473 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 138/289] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:13:34 2022] GET /compute/v2.1/servers/9f85118d-4e33-45e1-9dc6-ee755b6d9df3 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:13:34.767982 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-394fe897-5597-4419-993c-71fdc0d544b0 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:13:34.768580 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-394fe897-5597-4419-993c-71fdc0d544b0 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: 90f2768b-8259-439c-af06-7eff342615ee] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:13:34.775620 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-394fe897-5597-4419-993c-71fdc0d544b0 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:34.776233 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-394fe897-5597-4419-993c-71fdc0d544b0 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:34.776670 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-394fe897-5597-4419-993c-71fdc0d544b0 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:34.777361 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-394fe897-5597-4419-993c-71fdc0d544b0 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:34.777816 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-394fe897-5597-4419-993c-71fdc0d544b0 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:34.778497 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-394fe897-5597-4419-993c-71fdc0d544b0 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:34.913704 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-394fe897-5597-4419-993c-71fdc0d544b0 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1787a9ef7c44e28076aaa80c0152fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee21a91b84794e80b208fe72b7f1e010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:13:34.922023 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-394fe897-5597-4419-993c-71fdc0d544b0 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "GET /compute/v2.1/servers/90f2768b-8259-439c-af06-7eff342615ee" status: 200 len: 1522 microversion: 2.1 time: 0.158047 Oct 17 03:13:34.922568 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 152/290] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:13:34 2022] GET /compute/v2.1/servers/90f2768b-8259-439c-af06-7eff342615ee => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:13:35.317564 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-c7254077-1585-4f8a-9184-3f251098fc7f tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:13:35.318173 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-c7254077-1585-4f8a-9184-3f251098fc7f tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] [instance: 9f85118d-4e33-45e1-9dc6-ee755b6d9df3] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:13:35.324149 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-c7254077-1585-4f8a-9184-3f251098fc7f tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:35.324648 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-c7254077-1585-4f8a-9184-3f251098fc7f tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:35.325069 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-c7254077-1585-4f8a-9184-3f251098fc7f tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:35.327875 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-c7254077-1585-4f8a-9184-3f251098fc7f tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:35.327875 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-c7254077-1585-4f8a-9184-3f251098fc7f tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:35.327875 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-c7254077-1585-4f8a-9184-3f251098fc7f tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:35.460022 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-c7254077-1585-4f8a-9184-3f251098fc7f tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58fbb2d79954020aa1328ef6bf925e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b87c159313f74c77a95172124e82dc25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:13:35.467793 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-c7254077-1585-4f8a-9184-3f251098fc7f tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] 10.222.0.27 "GET /compute/v2.1/servers/9f85118d-4e33-45e1-9dc6-ee755b6d9df3" status: 200 len: 1314 microversion: 2.1 time: 0.154125 Oct 17 03:13:35.468411 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 139/291] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:13:35 2022] GET /compute/v2.1/servers/9f85118d-4e33-45e1-9dc6-ee755b6d9df3 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:13:35.949249 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-24ab25b4-0bee-4fe1-b5cc-cc91e7d798a0 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:13:35.950245 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-24ab25b4-0bee-4fe1-b5cc-cc91e7d798a0 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: 90f2768b-8259-439c-af06-7eff342615ee] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:13:35.956838 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-24ab25b4-0bee-4fe1-b5cc-cc91e7d798a0 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:35.957442 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-24ab25b4-0bee-4fe1-b5cc-cc91e7d798a0 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:35.957981 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-24ab25b4-0bee-4fe1-b5cc-cc91e7d798a0 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:35.958624 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-24ab25b4-0bee-4fe1-b5cc-cc91e7d798a0 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:35.959203 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-24ab25b4-0bee-4fe1-b5cc-cc91e7d798a0 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:35.959683 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-24ab25b4-0bee-4fe1-b5cc-cc91e7d798a0 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:36.102277 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-24ab25b4-0bee-4fe1-b5cc-cc91e7d798a0 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1787a9ef7c44e28076aaa80c0152fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee21a91b84794e80b208fe72b7f1e010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:13:36.111059 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-24ab25b4-0bee-4fe1-b5cc-cc91e7d798a0 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "GET /compute/v2.1/servers/90f2768b-8259-439c-af06-7eff342615ee" status: 200 len: 1522 microversion: 2.1 time: 0.166035 Oct 17 03:13:36.111282 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 153/292] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:13:35 2022] GET /compute/v2.1/servers/90f2768b-8259-439c-af06-7eff342615ee => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:13:36.492912 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-294b0a7f-74e5-430b-bdd2-b9516faba5d6 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:13:36.494205 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-294b0a7f-74e5-430b-bdd2-b9516faba5d6 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] [instance: 9f85118d-4e33-45e1-9dc6-ee755b6d9df3] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:13:36.500664 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-294b0a7f-74e5-430b-bdd2-b9516faba5d6 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:36.501223 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-294b0a7f-74e5-430b-bdd2-b9516faba5d6 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:36.501759 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-294b0a7f-74e5-430b-bdd2-b9516faba5d6 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:36.502540 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-294b0a7f-74e5-430b-bdd2-b9516faba5d6 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:36.503125 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-294b0a7f-74e5-430b-bdd2-b9516faba5d6 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:36.503623 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-294b0a7f-74e5-430b-bdd2-b9516faba5d6 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:36.656999 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-294b0a7f-74e5-430b-bdd2-b9516faba5d6 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58fbb2d79954020aa1328ef6bf925e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b87c159313f74c77a95172124e82dc25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:13:36.666038 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-294b0a7f-74e5-430b-bdd2-b9516faba5d6 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] 10.222.0.27 "GET /compute/v2.1/servers/9f85118d-4e33-45e1-9dc6-ee755b6d9df3" status: 200 len: 1314 microversion: 2.1 time: 0.179482 Oct 17 03:13:36.666617 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 140/293] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:13:36 2022] GET /compute/v2.1/servers/9f85118d-4e33-45e1-9dc6-ee755b6d9df3 => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:13:37.136753 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-ad9195ac-cb88-4413-b09f-10b158df5f39 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:13:37.137479 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-ad9195ac-cb88-4413-b09f-10b158df5f39 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: 90f2768b-8259-439c-af06-7eff342615ee] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:13:37.144179 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-ad9195ac-cb88-4413-b09f-10b158df5f39 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:37.145129 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-ad9195ac-cb88-4413-b09f-10b158df5f39 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:37.145891 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-ad9195ac-cb88-4413-b09f-10b158df5f39 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:37.147193 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-ad9195ac-cb88-4413-b09f-10b158df5f39 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:37.147727 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-ad9195ac-cb88-4413-b09f-10b158df5f39 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:37.148238 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-ad9195ac-cb88-4413-b09f-10b158df5f39 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:37.294139 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-ad9195ac-cb88-4413-b09f-10b158df5f39 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1787a9ef7c44e28076aaa80c0152fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee21a91b84794e80b208fe72b7f1e010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:13:37.300662 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-fce81e73-bf75-44f0-8c9d-c270ca5dc2bd tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:13:37.301233 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-fce81e73-bf75-44f0-8c9d-c270ca5dc2bd tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] [instance: 7b220b35-d9ac-48e4-b898-3d4f6c7be835] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:13:37.303177 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-ad9195ac-cb88-4413-b09f-10b158df5f39 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "GET /compute/v2.1/servers/90f2768b-8259-439c-af06-7eff342615ee" status: 200 len: 1522 microversion: 2.1 time: 0.170361 Oct 17 03:13:37.308144 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-fce81e73-bf75-44f0-8c9d-c270ca5dc2bd tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:37.308632 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-fce81e73-bf75-44f0-8c9d-c270ca5dc2bd tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:37.309064 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-fce81e73-bf75-44f0-8c9d-c270ca5dc2bd tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:37.309760 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-fce81e73-bf75-44f0-8c9d-c270ca5dc2bd tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:37.310213 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-fce81e73-bf75-44f0-8c9d-c270ca5dc2bd tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:37.310628 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-fce81e73-bf75-44f0-8c9d-c270ca5dc2bd tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:37.315277 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 154/294] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:13:37 2022] GET /compute/v2.1/servers/90f2768b-8259-439c-af06-7eff342615ee => generated 1522 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:13:37.336407 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-fce81e73-bf75-44f0-8c9d-c270ca5dc2bd tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] 10.222.0.27 "GET /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835/ips" status: 200 len: 147 microversion: 2.1 time: 0.040151 Oct 17 03:13:37.336916 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 141/295] 10.222.0.27 () {58 vars in 1248 bytes} [Mon Oct 17 03:13:37 2022] GET /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835/ips => generated 147 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 03:13:37.689783 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-19bc4852-d8de-4c92-ade2-49e41e486347 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:13:37.690474 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-19bc4852-d8de-4c92-ade2-49e41e486347 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] [instance: 9f85118d-4e33-45e1-9dc6-ee755b6d9df3] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:13:37.697167 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-19bc4852-d8de-4c92-ade2-49e41e486347 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:37.697729 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-19bc4852-d8de-4c92-ade2-49e41e486347 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:37.698052 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-19bc4852-d8de-4c92-ade2-49e41e486347 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:37.698754 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-19bc4852-d8de-4c92-ade2-49e41e486347 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:37.699240 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-19bc4852-d8de-4c92-ade2-49e41e486347 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:37.699663 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-19bc4852-d8de-4c92-ade2-49e41e486347 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:37.837790 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-19bc4852-d8de-4c92-ade2-49e41e486347 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58fbb2d79954020aa1328ef6bf925e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b87c159313f74c77a95172124e82dc25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:13:37.846342 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-19bc4852-d8de-4c92-ade2-49e41e486347 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] 10.222.0.27 "GET /compute/v2.1/servers/9f85118d-4e33-45e1-9dc6-ee755b6d9df3" status: 200 len: 1314 microversion: 2.1 time: 0.160655 Oct 17 03:13:37.846924 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 155/296] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:13:37 2022] GET /compute/v2.1/servers/9f85118d-4e33-45e1-9dc6-ee755b6d9df3 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:13:38.326839 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-d0c188f3-8e2e-4969-a467-ad8c7f1e28c1 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:13:38.327565 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-d0c188f3-8e2e-4969-a467-ad8c7f1e28c1 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: 90f2768b-8259-439c-af06-7eff342615ee] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:13:38.332758 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG dbcounter [-] [118887] Writing DB stats nova_cell0:SELECT=2 {{(pid=118887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:13:38.335862 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-d0c188f3-8e2e-4969-a467-ad8c7f1e28c1 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:38.336363 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-d0c188f3-8e2e-4969-a467-ad8c7f1e28c1 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:38.336814 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-d0c188f3-8e2e-4969-a467-ad8c7f1e28c1 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:38.337509 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-d0c188f3-8e2e-4969-a467-ad8c7f1e28c1 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:38.338036 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-d0c188f3-8e2e-4969-a467-ad8c7f1e28c1 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:38.338463 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-d0c188f3-8e2e-4969-a467-ad8c7f1e28c1 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:38.501514 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-d0c188f3-8e2e-4969-a467-ad8c7f1e28c1 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1787a9ef7c44e28076aaa80c0152fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee21a91b84794e80b208fe72b7f1e010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:13:38.510840 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-d0c188f3-8e2e-4969-a467-ad8c7f1e28c1 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "GET /compute/v2.1/servers/90f2768b-8259-439c-af06-7eff342615ee" status: 200 len: 1522 microversion: 2.1 time: 0.188066 Oct 17 03:13:38.511533 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 142/297] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:13:38 2022] GET /compute/v2.1/servers/90f2768b-8259-439c-af06-7eff342615ee => generated 1522 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:13:38.875210 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-e633a19f-fef2-49d3-addf-4b906b339173 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:13:38.875210 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-e633a19f-fef2-49d3-addf-4b906b339173 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] [instance: 9f85118d-4e33-45e1-9dc6-ee755b6d9df3] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:13:38.878128 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG dbcounter [-] [118886] Writing DB stats nova_cell0:SELECT=2 {{(pid=118886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:13:38.879266 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG dbcounter [-] [118886] Writing DB stats nova_cell0:SELECT=6 {{(pid=118886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:13:38.882021 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-e633a19f-fef2-49d3-addf-4b906b339173 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:38.882430 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-e633a19f-fef2-49d3-addf-4b906b339173 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:38.882971 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-e633a19f-fef2-49d3-addf-4b906b339173 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:38.883609 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-e633a19f-fef2-49d3-addf-4b906b339173 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:38.884069 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-e633a19f-fef2-49d3-addf-4b906b339173 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:38.884491 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-e633a19f-fef2-49d3-addf-4b906b339173 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:39.030034 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-e633a19f-fef2-49d3-addf-4b906b339173 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58fbb2d79954020aa1328ef6bf925e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b87c159313f74c77a95172124e82dc25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:13:39.039335 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-e633a19f-fef2-49d3-addf-4b906b339173 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] 10.222.0.27 "GET /compute/v2.1/servers/9f85118d-4e33-45e1-9dc6-ee755b6d9df3" status: 200 len: 1314 microversion: 2.1 time: 0.172662 Oct 17 03:13:39.039937 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 156/298] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:13:38 2022] GET /compute/v2.1/servers/9f85118d-4e33-45e1-9dc6-ee755b6d9df3 => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:13:39.533800 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-e6998cec-8744-4f9d-b3e5-bd27407d0a20 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:13:39.534396 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-e6998cec-8744-4f9d-b3e5-bd27407d0a20 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: 90f2768b-8259-439c-af06-7eff342615ee] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:13:39.541630 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-e6998cec-8744-4f9d-b3e5-bd27407d0a20 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:39.542136 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-e6998cec-8744-4f9d-b3e5-bd27407d0a20 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:39.542624 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-e6998cec-8744-4f9d-b3e5-bd27407d0a20 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:39.543491 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-e6998cec-8744-4f9d-b3e5-bd27407d0a20 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:39.543859 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-e6998cec-8744-4f9d-b3e5-bd27407d0a20 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:39.544281 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-e6998cec-8744-4f9d-b3e5-bd27407d0a20 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:39.687684 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-e6998cec-8744-4f9d-b3e5-bd27407d0a20 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1787a9ef7c44e28076aaa80c0152fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee21a91b84794e80b208fe72b7f1e010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:13:39.698994 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-e6998cec-8744-4f9d-b3e5-bd27407d0a20 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "GET /compute/v2.1/servers/90f2768b-8259-439c-af06-7eff342615ee" status: 200 len: 1522 microversion: 2.1 time: 0.169043 Oct 17 03:13:39.699572 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 143/299] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:13:39 2022] GET /compute/v2.1/servers/90f2768b-8259-439c-af06-7eff342615ee => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:13:39.999679 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-7168135d-c8dc-4e3f-8e18-9e234a41d0b2 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:13:40.000237 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-7168135d-c8dc-4e3f-8e18-9e234a41d0b2 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 603ee2bf-bedf-4688-ac0a-77a2a50f33d7] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:13:40.006526 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-7168135d-c8dc-4e3f-8e18-9e234a41d0b2 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:40.007093 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-7168135d-c8dc-4e3f-8e18-9e234a41d0b2 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:40.007532 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-7168135d-c8dc-4e3f-8e18-9e234a41d0b2 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:40.008228 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-7168135d-c8dc-4e3f-8e18-9e234a41d0b2 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:40.008686 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-7168135d-c8dc-4e3f-8e18-9e234a41d0b2 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:40.009105 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-7168135d-c8dc-4e3f-8e18-9e234a41d0b2 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:40.034365 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-7168135d-c8dc-4e3f-8e18-9e234a41d0b2 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7/ips" status: 200 len: 152 microversion: 2.20 time: 0.039543 Oct 17 03:13:40.034958 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 157/300] 10.222.0.27 () {60 vars in 1289 bytes} [Mon Oct 17 03:13:39 2022] GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7/ips => generated 152 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 03:13:40.068711 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-c6062cec-1723-448b-ba2b-56c0bcc0b696 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:13:40.071678 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-c6062cec-1723-448b-ba2b-56c0bcc0b696 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] [instance: 9f85118d-4e33-45e1-9dc6-ee755b6d9df3] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:13:40.079064 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-c6062cec-1723-448b-ba2b-56c0bcc0b696 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:40.079985 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-c6062cec-1723-448b-ba2b-56c0bcc0b696 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:40.080426 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-c6062cec-1723-448b-ba2b-56c0bcc0b696 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:40.081633 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-c6062cec-1723-448b-ba2b-56c0bcc0b696 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:40.082122 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-c6062cec-1723-448b-ba2b-56c0bcc0b696 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:40.082545 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-c6062cec-1723-448b-ba2b-56c0bcc0b696 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:40.253278 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-c6062cec-1723-448b-ba2b-56c0bcc0b696 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58fbb2d79954020aa1328ef6bf925e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b87c159313f74c77a95172124e82dc25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:13:40.262660 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-c6062cec-1723-448b-ba2b-56c0bcc0b696 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] 10.222.0.27 "GET /compute/v2.1/servers/9f85118d-4e33-45e1-9dc6-ee755b6d9df3" status: 200 len: 1314 microversion: 2.1 time: 0.202804 Oct 17 03:13:40.263917 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 144/301] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:13:40 2022] GET /compute/v2.1/servers/9f85118d-4e33-45e1-9dc6-ee755b6d9df3 => generated 1314 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:13:40.721568 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-b3c9d9b9-85d7-4d04-bb87-6cbb99624d65 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:13:40.722177 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-b3c9d9b9-85d7-4d04-bb87-6cbb99624d65 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: 90f2768b-8259-439c-af06-7eff342615ee] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:13:40.728358 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-b3c9d9b9-85d7-4d04-bb87-6cbb99624d65 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:40.728837 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-b3c9d9b9-85d7-4d04-bb87-6cbb99624d65 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:40.729269 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-b3c9d9b9-85d7-4d04-bb87-6cbb99624d65 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:40.729959 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-b3c9d9b9-85d7-4d04-bb87-6cbb99624d65 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:40.730410 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-b3c9d9b9-85d7-4d04-bb87-6cbb99624d65 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:40.730831 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-b3c9d9b9-85d7-4d04-bb87-6cbb99624d65 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:41.064836 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-b3c9d9b9-85d7-4d04-bb87-6cbb99624d65 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1787a9ef7c44e28076aaa80c0152fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee21a91b84794e80b208fe72b7f1e010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:13:41.073988 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-b3c9d9b9-85d7-4d04-bb87-6cbb99624d65 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "GET /compute/v2.1/servers/90f2768b-8259-439c-af06-7eff342615ee" status: 200 len: 1522 microversion: 2.1 time: 0.356233 Oct 17 03:13:41.074636 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 158/302] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:13:40 2022] GET /compute/v2.1/servers/90f2768b-8259-439c-af06-7eff342615ee => generated 1522 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:13:41.292488 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-3aee9c55-6e27-4073-8f39-5a1a732730df tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:13:41.293676 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-3aee9c55-6e27-4073-8f39-5a1a732730df tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] [instance: 9f85118d-4e33-45e1-9dc6-ee755b6d9df3] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:13:41.300116 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-3aee9c55-6e27-4073-8f39-5a1a732730df tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:41.300516 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-3aee9c55-6e27-4073-8f39-5a1a732730df tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:41.300948 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-3aee9c55-6e27-4073-8f39-5a1a732730df tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:41.301637 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-3aee9c55-6e27-4073-8f39-5a1a732730df tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:41.302088 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-3aee9c55-6e27-4073-8f39-5a1a732730df tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:41.302609 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-3aee9c55-6e27-4073-8f39-5a1a732730df tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:41.442811 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-3aee9c55-6e27-4073-8f39-5a1a732730df tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58fbb2d79954020aa1328ef6bf925e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b87c159313f74c77a95172124e82dc25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:13:41.452843 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-3aee9c55-6e27-4073-8f39-5a1a732730df tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] 10.222.0.27 "GET /compute/v2.1/servers/9f85118d-4e33-45e1-9dc6-ee755b6d9df3" status: 200 len: 1314 microversion: 2.1 time: 0.164291 Oct 17 03:13:41.453416 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 145/303] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:13:41 2022] GET /compute/v2.1/servers/9f85118d-4e33-45e1-9dc6-ee755b6d9df3 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:13:42.098367 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-90f84481-032c-482b-abfc-9f90cd7cab3c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:13:42.099161 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-90f84481-032c-482b-abfc-9f90cd7cab3c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: 90f2768b-8259-439c-af06-7eff342615ee] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:13:42.105971 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-90f84481-032c-482b-abfc-9f90cd7cab3c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:42.106576 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-90f84481-032c-482b-abfc-9f90cd7cab3c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:42.107106 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-90f84481-032c-482b-abfc-9f90cd7cab3c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:42.108067 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-90f84481-032c-482b-abfc-9f90cd7cab3c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:42.108579 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-90f84481-032c-482b-abfc-9f90cd7cab3c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:42.109086 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-90f84481-032c-482b-abfc-9f90cd7cab3c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:42.256610 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-90f84481-032c-482b-abfc-9f90cd7cab3c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1787a9ef7c44e28076aaa80c0152fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee21a91b84794e80b208fe72b7f1e010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:13:42.265077 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-90f84481-032c-482b-abfc-9f90cd7cab3c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "GET /compute/v2.1/servers/90f2768b-8259-439c-af06-7eff342615ee" status: 200 len: 1522 microversion: 2.1 time: 0.171486 Oct 17 03:13:42.266566 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 159/304] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:13:42 2022] GET /compute/v2.1/servers/90f2768b-8259-439c-af06-7eff342615ee => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:13:42.312809 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [req-6ddad785-071f-465d-b8ce-5dbea95fa757 req-7a394be3-ba7c-48e3-be06-d4e6ba468b05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f85118d-4e33-45e1-9dc6-ee755b6d9df3", "name": "network-vif-plugged", "status": "completed", "tag": "a058c34f-585b-4f34-a8f2-ddf3be0cb87e"}]} {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:13:42.323372 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG dbcounter [-] [118887] Writing DB stats nova_api:SELECT=84 {{(pid=118887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:13:42.326485 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [req-6ddad785-071f-465d-b8ce-5dbea95fa757 req-7a394be3-ba7c-48e3-be06-d4e6ba468b05 service nova] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:42.327635 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [req-6ddad785-071f-465d-b8ce-5dbea95fa757 req-7a394be3-ba7c-48e3-be06-d4e6ba468b05 service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:42.328262 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [req-6ddad785-071f-465d-b8ce-5dbea95fa757 req-7a394be3-ba7c-48e3-be06-d4e6ba468b05 service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:42.359199 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.compute.server_external_events [req-6ddad785-071f-465d-b8ce-5dbea95fa757 req-7a394be3-ba7c-48e3-be06-d4e6ba468b05 service nova] Creating event network-vif-plugged:a058c34f-585b-4f34-a8f2-ddf3be0cb87e for instance 9f85118d-4e33-45e1-9dc6-ee755b6d9df3 on hv-cinder-84697 Oct 17 03:13:42.366346 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [req-6ddad785-071f-465d-b8ce-5dbea95fa757 req-7a394be3-ba7c-48e3-be06-d4e6ba468b05 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057337 Oct 17 03:13:42.368261 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 146/305] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 03:13:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:13:42.493582 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-dc24e78b-7611-4763-b8af-2fcc3d166b01 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:13:42.494895 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-dc24e78b-7611-4763-b8af-2fcc3d166b01 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] [instance: 9f85118d-4e33-45e1-9dc6-ee755b6d9df3] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:13:42.519041 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-dc24e78b-7611-4763-b8af-2fcc3d166b01 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:42.519573 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-dc24e78b-7611-4763-b8af-2fcc3d166b01 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:42.520751 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-dc24e78b-7611-4763-b8af-2fcc3d166b01 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:42.524859 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-dc24e78b-7611-4763-b8af-2fcc3d166b01 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:42.525390 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-dc24e78b-7611-4763-b8af-2fcc3d166b01 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:42.530459 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-dc24e78b-7611-4763-b8af-2fcc3d166b01 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:42.744385 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-dc24e78b-7611-4763-b8af-2fcc3d166b01 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58fbb2d79954020aa1328ef6bf925e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b87c159313f74c77a95172124e82dc25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:13:42.755743 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-dc24e78b-7611-4763-b8af-2fcc3d166b01 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] 10.222.0.27 "GET /compute/v2.1/servers/9f85118d-4e33-45e1-9dc6-ee755b6d9df3" status: 200 len: 1314 microversion: 2.1 time: 0.283619 Oct 17 03:13:42.757471 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 160/306] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:13:42 2022] GET /compute/v2.1/servers/9f85118d-4e33-45e1-9dc6-ee755b6d9df3 => generated 1314 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:13:43.297772 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-50e2075b-c84d-4dec-8f36-0ea83227fd9c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:13:43.298462 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-50e2075b-c84d-4dec-8f36-0ea83227fd9c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: 90f2768b-8259-439c-af06-7eff342615ee] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:13:43.305743 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-50e2075b-c84d-4dec-8f36-0ea83227fd9c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:43.306223 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-50e2075b-c84d-4dec-8f36-0ea83227fd9c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:43.306654 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-50e2075b-c84d-4dec-8f36-0ea83227fd9c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:43.307360 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-50e2075b-c84d-4dec-8f36-0ea83227fd9c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:43.307817 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-50e2075b-c84d-4dec-8f36-0ea83227fd9c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:43.308235 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-50e2075b-c84d-4dec-8f36-0ea83227fd9c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:43.312213 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG dbcounter [-] [118887] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:13:43.349116 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-6da88c07-e860-4672-be27-50c31b15252d tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:13:43.350249 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-6da88c07-e860-4672-be27-50c31b15252d tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 603ee2bf-bedf-4688-ac0a-77a2a50f33d7] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:13:43.352582 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG dbcounter [-] [118886] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=118886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:13:43.358811 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-6da88c07-e860-4672-be27-50c31b15252d tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:43.359422 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-6da88c07-e860-4672-be27-50c31b15252d tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:43.359917 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-6da88c07-e860-4672-be27-50c31b15252d tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:43.360630 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-6da88c07-e860-4672-be27-50c31b15252d tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:43.361088 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-6da88c07-e860-4672-be27-50c31b15252d tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:43.361562 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-6da88c07-e860-4672-be27-50c31b15252d tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:43.390036 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.objects.instance [None req-6da88c07-e860-4672-be27-50c31b15252d tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lazy-loading 'flavor' on Instance uuid 603ee2bf-bedf-4688-ac0a-77a2a50f33d7 {{(pid=118886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 03:13:43.444236 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-50e2075b-c84d-4dec-8f36-0ea83227fd9c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1787a9ef7c44e28076aaa80c0152fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee21a91b84794e80b208fe72b7f1e010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:13:43.452479 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-50e2075b-c84d-4dec-8f36-0ea83227fd9c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "GET /compute/v2.1/servers/90f2768b-8259-439c-af06-7eff342615ee" status: 200 len: 1522 microversion: 2.1 time: 0.158910 Oct 17 03:13:43.453232 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 147/307] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:13:43 2022] GET /compute/v2.1/servers/90f2768b-8259-439c-af06-7eff342615ee => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:13:43.612012 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-6da88c07-e860-4672-be27-50c31b15252d tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "POST /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7/action" status: 202 len: 0 microversion: 2.20 time: 0.266874 Oct 17 03:13:43.612611 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 161/308] 10.222.0.27 () {62 vars in 1319 bytes} [Mon Oct 17 03:13:43 2022] POST /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7/action => generated 0 bytes in 269 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 17 03:13:43.621776 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-f6987d60-15c0-49e4-88bf-8e9e9113e621 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:13:43.622893 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-f6987d60-15c0-49e4-88bf-8e9e9113e621 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 603ee2bf-bedf-4688-ac0a-77a2a50f33d7] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:13:43.629931 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-f6987d60-15c0-49e4-88bf-8e9e9113e621 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:43.630493 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-f6987d60-15c0-49e4-88bf-8e9e9113e621 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:43.631226 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-f6987d60-15c0-49e4-88bf-8e9e9113e621 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:43.632084 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-f6987d60-15c0-49e4-88bf-8e9e9113e621 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:43.632710 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-f6987d60-15c0-49e4-88bf-8e9e9113e621 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:43.633294 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-f6987d60-15c0-49e4-88bf-8e9e9113e621 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:43.782032 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-dd3ade53-ce47-4a8a-abbb-c2e7435b3b52 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:13:43.782741 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-f6987d60-15c0-49e4-88bf-8e9e9113e621 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:13:43.782897 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-dd3ade53-ce47-4a8a-abbb-c2e7435b3b52 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] [instance: 9f85118d-4e33-45e1-9dc6-ee755b6d9df3] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:13:43.790774 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-dd3ade53-ce47-4a8a-abbb-c2e7435b3b52 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:43.791349 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-dd3ade53-ce47-4a8a-abbb-c2e7435b3b52 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:43.791844 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-dd3ade53-ce47-4a8a-abbb-c2e7435b3b52 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:43.792589 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-f6987d60-15c0-49e4-88bf-8e9e9113e621 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:13:43.792709 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-dd3ade53-ce47-4a8a-abbb-c2e7435b3b52 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:43.793123 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-dd3ade53-ce47-4a8a-abbb-c2e7435b3b52 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:43.793615 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-dd3ade53-ce47-4a8a-abbb-c2e7435b3b52 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:43.794407 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-f6987d60-15c0-49e4-88bf-8e9e9113e621 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:13:43.795704 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-f6987d60-15c0-49e4-88bf-8e9e9113e621 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7" status: 200 len: 1724 microversion: 2.20 time: 0.178311 Oct 17 03:13:43.801332 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 148/309] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 03:13:43 2022] GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7 => generated 1724 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:13:43.801874 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-29e51405-5128-4b43-8083-7079be54a765 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a623ca03-fc4b-4f8d-a135-b53c4919cf01"}} {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:13:43.804648 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-29e51405-5128-4b43-8083-7079be54a765 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] [instance: 7b220b35-d9ac-48e4-b898-3d4f6c7be835] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:13:43.811320 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-29e51405-5128-4b43-8083-7079be54a765 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:43.811840 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-29e51405-5128-4b43-8083-7079be54a765 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:43.812359 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-29e51405-5128-4b43-8083-7079be54a765 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:43.813148 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-29e51405-5128-4b43-8083-7079be54a765 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:43.813786 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-29e51405-5128-4b43-8083-7079be54a765 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:43.814467 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-29e51405-5128-4b43-8083-7079be54a765 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:43.944939 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-dd3ade53-ce47-4a8a-abbb-c2e7435b3b52 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58fbb2d79954020aa1328ef6bf925e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b87c159313f74c77a95172124e82dc25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:13:43.952678 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-dd3ade53-ce47-4a8a-abbb-c2e7435b3b52 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] 10.222.0.27 "GET /compute/v2.1/servers/9f85118d-4e33-45e1-9dc6-ee755b6d9df3" status: 200 len: 1314 microversion: 2.1 time: 0.175629 Oct 17 03:13:43.953246 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 162/310] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:13:43 2022] GET /compute/v2.1/servers/9f85118d-4e33-45e1-9dc6-ee755b6d9df3 => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:13:44.475605 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-113bd275-14f4-4953-b566-7e5b687d78c3 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:13:44.476226 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-113bd275-14f4-4953-b566-7e5b687d78c3 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: 90f2768b-8259-439c-af06-7eff342615ee] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:13:44.483222 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-113bd275-14f4-4953-b566-7e5b687d78c3 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:44.483706 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-113bd275-14f4-4953-b566-7e5b687d78c3 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:44.484167 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-113bd275-14f4-4953-b566-7e5b687d78c3 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:44.485243 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-113bd275-14f4-4953-b566-7e5b687d78c3 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:44.485722 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-113bd275-14f4-4953-b566-7e5b687d78c3 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:44.486177 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-113bd275-14f4-4953-b566-7e5b687d78c3 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:44.619345 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-113bd275-14f4-4953-b566-7e5b687d78c3 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1787a9ef7c44e28076aaa80c0152fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee21a91b84794e80b208fe72b7f1e010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:13:44.622919 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG dbcounter [-] [118886] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:13:44.628119 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-113bd275-14f4-4953-b566-7e5b687d78c3 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "GET /compute/v2.1/servers/90f2768b-8259-439c-af06-7eff342615ee" status: 200 len: 1522 microversion: 2.1 time: 0.157013 Oct 17 03:13:44.628716 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 163/311] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:13:44 2022] GET /compute/v2.1/servers/90f2768b-8259-439c-af06-7eff342615ee => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:13:44.825230 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-1b8ebf29-1573-462e-808f-6159deda20b8 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:13:44.825854 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-1b8ebf29-1573-462e-808f-6159deda20b8 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 603ee2bf-bedf-4688-ac0a-77a2a50f33d7] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:13:44.832970 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-1b8ebf29-1573-462e-808f-6159deda20b8 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:44.833522 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-1b8ebf29-1573-462e-808f-6159deda20b8 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:44.833948 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-1b8ebf29-1573-462e-808f-6159deda20b8 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:44.835096 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-1b8ebf29-1573-462e-808f-6159deda20b8 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:44.835583 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-1b8ebf29-1573-462e-808f-6159deda20b8 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:44.836000 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-1b8ebf29-1573-462e-808f-6159deda20b8 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:44.968521 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-1b8ebf29-1573-462e-808f-6159deda20b8 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:13:44.977164 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-1b8ebf29-1573-462e-808f-6159deda20b8 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:13:44.978600 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-1b8ebf29-1573-462e-808f-6159deda20b8 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:13:44.979772 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-1b8ebf29-1573-462e-808f-6159deda20b8 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7" status: 200 len: 1724 microversion: 2.20 time: 0.159665 Oct 17 03:13:44.980317 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 164/312] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 03:13:44 2022] GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 03:13:44.984595 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-a87225ed-ec1a-4e6f-849c-fb14fed835f9 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:13:44.985156 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-a87225ed-ec1a-4e6f-849c-fb14fed835f9 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] [instance: 9f85118d-4e33-45e1-9dc6-ee755b6d9df3] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:13:44.991230 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-a87225ed-ec1a-4e6f-849c-fb14fed835f9 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:44.991758 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-a87225ed-ec1a-4e6f-849c-fb14fed835f9 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:44.992185 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-a87225ed-ec1a-4e6f-849c-fb14fed835f9 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:44.992862 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-a87225ed-ec1a-4e6f-849c-fb14fed835f9 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:44.993306 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-a87225ed-ec1a-4e6f-849c-fb14fed835f9 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:44.993719 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-a87225ed-ec1a-4e6f-849c-fb14fed835f9 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:45.124070 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-a87225ed-ec1a-4e6f-849c-fb14fed835f9 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58fbb2d79954020aa1328ef6bf925e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b87c159313f74c77a95172124e82dc25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:13:45.133123 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-a87225ed-ec1a-4e6f-849c-fb14fed835f9 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] 10.222.0.27 "GET /compute/v2.1/servers/9f85118d-4e33-45e1-9dc6-ee755b6d9df3" status: 200 len: 1314 microversion: 2.1 time: 0.151773 Oct 17 03:13:45.133682 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 165/313] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:13:44 2022] GET /compute/v2.1/servers/9f85118d-4e33-45e1-9dc6-ee755b6d9df3 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:13:45.651643 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-57921b4f-20bf-4618-ac9c-9f67cb926715 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:13:45.652276 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-57921b4f-20bf-4618-ac9c-9f67cb926715 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: 90f2768b-8259-439c-af06-7eff342615ee] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:13:45.658794 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-57921b4f-20bf-4618-ac9c-9f67cb926715 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:45.659309 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-57921b4f-20bf-4618-ac9c-9f67cb926715 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:45.659739 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-57921b4f-20bf-4618-ac9c-9f67cb926715 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:45.660452 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-57921b4f-20bf-4618-ac9c-9f67cb926715 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:45.660887 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-57921b4f-20bf-4618-ac9c-9f67cb926715 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:45.661307 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-57921b4f-20bf-4618-ac9c-9f67cb926715 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:45.808127 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-57921b4f-20bf-4618-ac9c-9f67cb926715 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1787a9ef7c44e28076aaa80c0152fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee21a91b84794e80b208fe72b7f1e010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:13:45.816480 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-57921b4f-20bf-4618-ac9c-9f67cb926715 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "GET /compute/v2.1/servers/90f2768b-8259-439c-af06-7eff342615ee" status: 200 len: 1522 microversion: 2.1 time: 0.168541 Oct 17 03:13:45.817056 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 166/314] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:13:45 2022] GET /compute/v2.1/servers/90f2768b-8259-439c-af06-7eff342615ee => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:13:46.006190 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-6e77c7f4-df0e-499c-bb49-3a7b0253855a tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:13:46.006844 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-6e77c7f4-df0e-499c-bb49-3a7b0253855a tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 603ee2bf-bedf-4688-ac0a-77a2a50f33d7] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:13:46.013366 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-6e77c7f4-df0e-499c-bb49-3a7b0253855a tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:46.013845 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-6e77c7f4-df0e-499c-bb49-3a7b0253855a tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:46.014365 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-6e77c7f4-df0e-499c-bb49-3a7b0253855a tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:46.015102 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-6e77c7f4-df0e-499c-bb49-3a7b0253855a tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:46.015667 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-6e77c7f4-df0e-499c-bb49-3a7b0253855a tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:46.016107 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-6e77c7f4-df0e-499c-bb49-3a7b0253855a tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:46.154737 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-6e77c7f4-df0e-499c-bb49-3a7b0253855a tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:13:46.163842 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-6e77c7f4-df0e-499c-bb49-3a7b0253855a tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:13:46.165358 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-6e77c7f4-df0e-499c-bb49-3a7b0253855a tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:13:46.166551 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-6e77c7f4-df0e-499c-bb49-3a7b0253855a tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7" status: 200 len: 1724 microversion: 2.20 time: 0.164746 Oct 17 03:13:46.167147 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 167/315] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 03:13:46 2022] GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7 => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:13:46.171662 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-ebfd6a25-cf71-434a-9c2d-de95d4cc5cac tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:13:46.172264 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-ebfd6a25-cf71-434a-9c2d-de95d4cc5cac tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] [instance: 9f85118d-4e33-45e1-9dc6-ee755b6d9df3] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:13:46.178025 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-ebfd6a25-cf71-434a-9c2d-de95d4cc5cac tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:46.178497 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-ebfd6a25-cf71-434a-9c2d-de95d4cc5cac tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:46.178986 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-ebfd6a25-cf71-434a-9c2d-de95d4cc5cac tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:46.179705 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-ebfd6a25-cf71-434a-9c2d-de95d4cc5cac tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:46.180189 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-ebfd6a25-cf71-434a-9c2d-de95d4cc5cac tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:46.180633 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-ebfd6a25-cf71-434a-9c2d-de95d4cc5cac tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:46.321494 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-ebfd6a25-cf71-434a-9c2d-de95d4cc5cac tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58fbb2d79954020aa1328ef6bf925e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b87c159313f74c77a95172124e82dc25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:13:46.329018 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-ebfd6a25-cf71-434a-9c2d-de95d4cc5cac tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] 10.222.0.27 "GET /compute/v2.1/servers/9f85118d-4e33-45e1-9dc6-ee755b6d9df3" status: 200 len: 1314 microversion: 2.1 time: 0.160895 Oct 17 03:13:46.329572 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 168/316] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:13:46 2022] GET /compute/v2.1/servers/9f85118d-4e33-45e1-9dc6-ee755b6d9df3 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:13:46.358052 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-d9526a24-e347-4ec3-b754-fd9bfc338dcd tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:13:46.358576 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-d9526a24-e347-4ec3-b754-fd9bfc338dcd tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] [instance: 4fc83673-1557-4eb9-b80b-825364198d8a] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:13:46.364581 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-d9526a24-e347-4ec3-b754-fd9bfc338dcd tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:46.365094 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-d9526a24-e347-4ec3-b754-fd9bfc338dcd tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:46.365814 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-d9526a24-e347-4ec3-b754-fd9bfc338dcd tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:46.366592 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-d9526a24-e347-4ec3-b754-fd9bfc338dcd tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:46.367142 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-d9526a24-e347-4ec3-b754-fd9bfc338dcd tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:46.367620 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-d9526a24-e347-4ec3-b754-fd9bfc338dcd tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:46.391472 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-d9526a24-e347-4ec3-b754-fd9bfc338dcd tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] 10.222.0.27 "GET /compute/v2.1/servers/4fc83673-1557-4eb9-b80b-825364198d8a/ips" status: 200 len: 150 microversion: 2.1 time: 0.037133 Oct 17 03:13:46.392028 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 169/317] 10.222.0.27 () {58 vars in 1248 bytes} [Mon Oct 17 03:13:46 2022] GET /compute/v2.1/servers/4fc83673-1557-4eb9-b80b-825364198d8a/ips => generated 150 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 03:13:46.840725 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-8b909da7-fde3-494c-90a7-52c2cf49ff7f tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:13:46.842266 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-8b909da7-fde3-494c-90a7-52c2cf49ff7f tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: 90f2768b-8259-439c-af06-7eff342615ee] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:13:46.849136 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-8b909da7-fde3-494c-90a7-52c2cf49ff7f tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:46.851135 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-8b909da7-fde3-494c-90a7-52c2cf49ff7f tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:46.851585 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-8b909da7-fde3-494c-90a7-52c2cf49ff7f tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:46.852353 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-8b909da7-fde3-494c-90a7-52c2cf49ff7f tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:46.852814 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-8b909da7-fde3-494c-90a7-52c2cf49ff7f tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:46.853243 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-8b909da7-fde3-494c-90a7-52c2cf49ff7f tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:46.985079 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-8b909da7-fde3-494c-90a7-52c2cf49ff7f tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1787a9ef7c44e28076aaa80c0152fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee21a91b84794e80b208fe72b7f1e010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:13:46.993666 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-8b909da7-fde3-494c-90a7-52c2cf49ff7f tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "GET /compute/v2.1/servers/90f2768b-8259-439c-af06-7eff342615ee" status: 200 len: 1522 microversion: 2.1 time: 0.156951 Oct 17 03:13:46.994294 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 170/318] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:13:46 2022] GET /compute/v2.1/servers/90f2768b-8259-439c-af06-7eff342615ee => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:13:47.171839 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-29e51405-5128-4b43-8083-7079be54a765 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] 10.222.0.27 "POST /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.373792 Oct 17 03:13:47.172511 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 149/319] 10.222.0.27 () {60 vars in 1323 bytes} [Mon Oct 17 03:13:43 2022] POST /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835/os-volume_attachments => generated 194 bytes in 3375 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:13:47.194882 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-e40a3a84-6c3c-4cce-8f83-d2eec2199ab5 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:13:47.195697 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-e40a3a84-6c3c-4cce-8f83-d2eec2199ab5 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 603ee2bf-bedf-4688-ac0a-77a2a50f33d7] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:13:47.202617 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-e40a3a84-6c3c-4cce-8f83-d2eec2199ab5 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:47.203211 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-e40a3a84-6c3c-4cce-8f83-d2eec2199ab5 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:47.203910 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-e40a3a84-6c3c-4cce-8f83-d2eec2199ab5 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:47.204620 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-e40a3a84-6c3c-4cce-8f83-d2eec2199ab5 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:47.205335 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-e40a3a84-6c3c-4cce-8f83-d2eec2199ab5 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:47.205750 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-e40a3a84-6c3c-4cce-8f83-d2eec2199ab5 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:47.350213 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-e40a3a84-6c3c-4cce-8f83-d2eec2199ab5 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:13:47.354355 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-b580d200-c9ec-423b-9b2c-d8ef0706747a tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:13:47.355194 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-b580d200-c9ec-423b-9b2c-d8ef0706747a tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] [instance: 9f85118d-4e33-45e1-9dc6-ee755b6d9df3] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:13:47.360493 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-e40a3a84-6c3c-4cce-8f83-d2eec2199ab5 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:13:47.361514 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-b580d200-c9ec-423b-9b2c-d8ef0706747a tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:47.362000 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-b580d200-c9ec-423b-9b2c-d8ef0706747a tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:47.362428 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-b580d200-c9ec-423b-9b2c-d8ef0706747a tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:47.363261 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-e40a3a84-6c3c-4cce-8f83-d2eec2199ab5 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:13:47.363417 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-b580d200-c9ec-423b-9b2c-d8ef0706747a tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:47.363724 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-b580d200-c9ec-423b-9b2c-d8ef0706747a tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:47.364259 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-b580d200-c9ec-423b-9b2c-d8ef0706747a tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:47.367116 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-e40a3a84-6c3c-4cce-8f83-d2eec2199ab5 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7" status: 200 len: 1724 microversion: 2.20 time: 0.177495 Oct 17 03:13:47.367713 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 171/320] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 03:13:47 2022] GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7 => generated 1724 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:13:47.513204 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-b580d200-c9ec-423b-9b2c-d8ef0706747a tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58fbb2d79954020aa1328ef6bf925e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b87c159313f74c77a95172124e82dc25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:13:47.521881 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-b580d200-c9ec-423b-9b2c-d8ef0706747a tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] 10.222.0.27 "GET /compute/v2.1/servers/9f85118d-4e33-45e1-9dc6-ee755b6d9df3" status: 200 len: 1497 microversion: 2.1 time: 0.172548 Oct 17 03:13:47.522448 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 150/321] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:13:47 2022] GET /compute/v2.1/servers/9f85118d-4e33-45e1-9dc6-ee755b6d9df3 => generated 1497 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:13:47.796587 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-1d56c2d1-891f-4fbc-8008-4afdd1bebf9d tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "acc77ace-8d37-4857-8e81-f7950fb7fa51"}} {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:13:47.799543 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-1d56c2d1-891f-4fbc-8008-4afdd1bebf9d tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] [instance: 4fc83673-1557-4eb9-b80b-825364198d8a] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:13:47.807240 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-1d56c2d1-891f-4fbc-8008-4afdd1bebf9d tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:47.807940 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-1d56c2d1-891f-4fbc-8008-4afdd1bebf9d tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:47.808624 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-1d56c2d1-891f-4fbc-8008-4afdd1bebf9d tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:47.809422 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-1d56c2d1-891f-4fbc-8008-4afdd1bebf9d tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:47.810046 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-1d56c2d1-891f-4fbc-8008-4afdd1bebf9d tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:47.810581 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-1d56c2d1-891f-4fbc-8008-4afdd1bebf9d tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:48.019665 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-b35f7b46-3a8f-4d3a-9210-a487a93a80c9 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:13:48.020427 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-b35f7b46-3a8f-4d3a-9210-a487a93a80c9 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: 90f2768b-8259-439c-af06-7eff342615ee] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:13:48.028915 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-b35f7b46-3a8f-4d3a-9210-a487a93a80c9 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:48.030082 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-b35f7b46-3a8f-4d3a-9210-a487a93a80c9 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:48.030763 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-b35f7b46-3a8f-4d3a-9210-a487a93a80c9 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:48.031888 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-b35f7b46-3a8f-4d3a-9210-a487a93a80c9 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:48.032546 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-b35f7b46-3a8f-4d3a-9210-a487a93a80c9 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:48.033364 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-b35f7b46-3a8f-4d3a-9210-a487a93a80c9 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:48.284055 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-1d56c2d1-891f-4fbc-8008-4afdd1bebf9d tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] 10.222.0.27 "POST /compute/v2.1/servers/4fc83673-1557-4eb9-b80b-825364198d8a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.491590 Oct 17 03:13:48.285346 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 172/322] 10.222.0.27 () {60 vars in 1323 bytes} [Mon Oct 17 03:13:47 2022] POST /compute/v2.1/servers/4fc83673-1557-4eb9-b80b-825364198d8a/os-volume_attachments => generated 194 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:13:48.295677 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-1c14abd7-6d75-439f-a89c-b57e147deffb tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:13:48.296473 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-1c14abd7-6d75-439f-a89c-b57e147deffb tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] [instance: 9f85118d-4e33-45e1-9dc6-ee755b6d9df3] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:13:48.304365 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-1c14abd7-6d75-439f-a89c-b57e147deffb tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:48.305070 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-1c14abd7-6d75-439f-a89c-b57e147deffb tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:48.305765 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-1c14abd7-6d75-439f-a89c-b57e147deffb tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:48.306759 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-1c14abd7-6d75-439f-a89c-b57e147deffb tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:48.307388 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-1c14abd7-6d75-439f-a89c-b57e147deffb tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:48.308307 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-1c14abd7-6d75-439f-a89c-b57e147deffb tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:48.324342 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-b35f7b46-3a8f-4d3a-9210-a487a93a80c9 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1787a9ef7c44e28076aaa80c0152fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee21a91b84794e80b208fe72b7f1e010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:13:48.336434 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-b35f7b46-3a8f-4d3a-9210-a487a93a80c9 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "GET /compute/v2.1/servers/90f2768b-8259-439c-af06-7eff342615ee" status: 200 len: 1522 microversion: 2.1 time: 0.321156 Oct 17 03:13:48.342621 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-1c14abd7-6d75-439f-a89c-b57e147deffb tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] [instance: 9f85118d-4e33-45e1-9dc6-ee755b6d9df3] Going to try to terminate instance {{(pid=118886) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 03:13:48.355395 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 151/323] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:13:48 2022] GET /compute/v2.1/servers/90f2768b-8259-439c-af06-7eff342615ee => generated 1522 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:13:48.402031 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-831a609b-1c80-49af-95ff-7e46bcefa076 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:13:48.404591 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-831a609b-1c80-49af-95ff-7e46bcefa076 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 603ee2bf-bedf-4688-ac0a-77a2a50f33d7] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:13:48.418624 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-831a609b-1c80-49af-95ff-7e46bcefa076 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:48.419372 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-831a609b-1c80-49af-95ff-7e46bcefa076 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:48.419911 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-831a609b-1c80-49af-95ff-7e46bcefa076 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:48.421036 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-831a609b-1c80-49af-95ff-7e46bcefa076 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:48.421768 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-831a609b-1c80-49af-95ff-7e46bcefa076 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:48.422776 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-831a609b-1c80-49af-95ff-7e46bcefa076 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:48.429055 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-1c14abd7-6d75-439f-a89c-b57e147deffb tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] 10.222.0.27 "DELETE /compute/v2.1/servers/9f85118d-4e33-45e1-9dc6-ee755b6d9df3" status: 204 len: 0 microversion: 2.1 time: 0.141403 Oct 17 03:13:48.429869 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 173/324] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 03:13:48 2022] DELETE /compute/v2.1/servers/9f85118d-4e33-45e1-9dc6-ee755b6d9df3 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 03:13:48.438788 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-6d75810f-86ae-44cf-b4a0-f771b46a44c4 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:13:48.439665 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-6d75810f-86ae-44cf-b4a0-f771b46a44c4 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] [instance: 9f85118d-4e33-45e1-9dc6-ee755b6d9df3] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:13:48.450025 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-6d75810f-86ae-44cf-b4a0-f771b46a44c4 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:48.450508 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-6d75810f-86ae-44cf-b4a0-f771b46a44c4 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:48.450979 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-6d75810f-86ae-44cf-b4a0-f771b46a44c4 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:48.451739 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-6d75810f-86ae-44cf-b4a0-f771b46a44c4 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:48.452198 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-6d75810f-86ae-44cf-b4a0-f771b46a44c4 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:48.452622 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-6d75810f-86ae-44cf-b4a0-f771b46a44c4 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:48.610273 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-6d75810f-86ae-44cf-b4a0-f771b46a44c4 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58fbb2d79954020aa1328ef6bf925e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b87c159313f74c77a95172124e82dc25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:13:48.619617 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-6d75810f-86ae-44cf-b4a0-f771b46a44c4 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] 10.222.0.27 "GET /compute/v2.1/servers/9f85118d-4e33-45e1-9dc6-ee755b6d9df3" status: 200 len: 1503 microversion: 2.1 time: 0.185169 Oct 17 03:13:48.620773 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 174/325] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:13:48 2022] GET /compute/v2.1/servers/9f85118d-4e33-45e1-9dc6-ee755b6d9df3 => generated 1503 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:13:48.864444 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-831a609b-1c80-49af-95ff-7e46bcefa076 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:13:48.874883 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-831a609b-1c80-49af-95ff-7e46bcefa076 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:13:48.876624 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-831a609b-1c80-49af-95ff-7e46bcefa076 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:13:48.877800 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-831a609b-1c80-49af-95ff-7e46bcefa076 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7" status: 200 len: 1724 microversion: 2.20 time: 0.483614 Oct 17 03:13:48.878348 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 152/326] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 03:13:48 2022] GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7 => generated 1724 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:13:49.361653 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-f696ef9a-c544-4f51-bb42-ee9d24aba056 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:13:49.362253 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-f696ef9a-c544-4f51-bb42-ee9d24aba056 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: 90f2768b-8259-439c-af06-7eff342615ee] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:13:49.370031 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-f696ef9a-c544-4f51-bb42-ee9d24aba056 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:49.370514 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-f696ef9a-c544-4f51-bb42-ee9d24aba056 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:49.370972 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-f696ef9a-c544-4f51-bb42-ee9d24aba056 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:49.371659 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-f696ef9a-c544-4f51-bb42-ee9d24aba056 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:49.372108 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-f696ef9a-c544-4f51-bb42-ee9d24aba056 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:49.372525 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-f696ef9a-c544-4f51-bb42-ee9d24aba056 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:49.503789 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-f696ef9a-c544-4f51-bb42-ee9d24aba056 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1787a9ef7c44e28076aaa80c0152fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee21a91b84794e80b208fe72b7f1e010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:13:49.512418 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-f696ef9a-c544-4f51-bb42-ee9d24aba056 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "GET /compute/v2.1/servers/90f2768b-8259-439c-af06-7eff342615ee" status: 200 len: 1522 microversion: 2.1 time: 0.154608 Oct 17 03:13:49.512979 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 175/327] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:13:49 2022] GET /compute/v2.1/servers/90f2768b-8259-439c-af06-7eff342615ee => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:13:49.643272 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-d7467857-e2b9-448c-bb9d-5860af7a4bd6 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:13:49.643875 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-d7467857-e2b9-448c-bb9d-5860af7a4bd6 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] [instance: 9f85118d-4e33-45e1-9dc6-ee755b6d9df3] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:13:49.650478 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-d7467857-e2b9-448c-bb9d-5860af7a4bd6 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:49.650997 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-d7467857-e2b9-448c-bb9d-5860af7a4bd6 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:49.651431 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-d7467857-e2b9-448c-bb9d-5860af7a4bd6 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:49.652118 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-d7467857-e2b9-448c-bb9d-5860af7a4bd6 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:49.652583 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-d7467857-e2b9-448c-bb9d-5860af7a4bd6 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:49.652985 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-d7467857-e2b9-448c-bb9d-5860af7a4bd6 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:49.787228 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-d7467857-e2b9-448c-bb9d-5860af7a4bd6 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58fbb2d79954020aa1328ef6bf925e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b87c159313f74c77a95172124e82dc25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:13:49.794883 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-d7467857-e2b9-448c-bb9d-5860af7a4bd6 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] 10.222.0.27 "GET /compute/v2.1/servers/9f85118d-4e33-45e1-9dc6-ee755b6d9df3" status: 200 len: 1503 microversion: 2.1 time: 0.155595 Oct 17 03:13:49.795454 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 153/328] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:13:49 2022] GET /compute/v2.1/servers/9f85118d-4e33-45e1-9dc6-ee755b6d9df3 => generated 1503 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:13:49.908430 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-6e40fb46-0ee3-4990-9e1c-21aaa5464f24 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:13:49.909452 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-6e40fb46-0ee3-4990-9e1c-21aaa5464f24 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 603ee2bf-bedf-4688-ac0a-77a2a50f33d7] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:13:49.917001 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-6e40fb46-0ee3-4990-9e1c-21aaa5464f24 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:49.917340 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-6e40fb46-0ee3-4990-9e1c-21aaa5464f24 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:49.917762 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-6e40fb46-0ee3-4990-9e1c-21aaa5464f24 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:49.919147 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-6e40fb46-0ee3-4990-9e1c-21aaa5464f24 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:49.919709 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-6e40fb46-0ee3-4990-9e1c-21aaa5464f24 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:49.920130 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-6e40fb46-0ee3-4990-9e1c-21aaa5464f24 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:50.063716 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-6e40fb46-0ee3-4990-9e1c-21aaa5464f24 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:13:50.072699 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-6e40fb46-0ee3-4990-9e1c-21aaa5464f24 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:13:50.074167 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-6e40fb46-0ee3-4990-9e1c-21aaa5464f24 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:13:50.075405 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-6e40fb46-0ee3-4990-9e1c-21aaa5464f24 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7" status: 200 len: 1724 microversion: 2.20 time: 0.172185 Oct 17 03:13:50.076292 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 176/329] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 03:13:49 2022] GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7 => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:13:50.536118 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-382e0d06-5f3f-491b-8149-f11552310d41 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:13:50.536737 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-382e0d06-5f3f-491b-8149-f11552310d41 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: 90f2768b-8259-439c-af06-7eff342615ee] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:13:50.543563 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-382e0d06-5f3f-491b-8149-f11552310d41 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:50.544057 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-382e0d06-5f3f-491b-8149-f11552310d41 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:50.544546 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-382e0d06-5f3f-491b-8149-f11552310d41 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:50.545240 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-382e0d06-5f3f-491b-8149-f11552310d41 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:50.545695 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-382e0d06-5f3f-491b-8149-f11552310d41 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:50.546119 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-382e0d06-5f3f-491b-8149-f11552310d41 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:50.685916 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-382e0d06-5f3f-491b-8149-f11552310d41 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1787a9ef7c44e28076aaa80c0152fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee21a91b84794e80b208fe72b7f1e010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:13:50.694656 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-382e0d06-5f3f-491b-8149-f11552310d41 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "GET /compute/v2.1/servers/90f2768b-8259-439c-af06-7eff342615ee" status: 200 len: 1522 microversion: 2.1 time: 0.162375 Oct 17 03:13:50.695378 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 154/330] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:13:50 2022] GET /compute/v2.1/servers/90f2768b-8259-439c-af06-7eff342615ee => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:13:50.817569 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-4c5cd380-7647-4e9c-9663-a5b388dda318 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:13:50.818764 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-4c5cd380-7647-4e9c-9663-a5b388dda318 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] [instance: 9f85118d-4e33-45e1-9dc6-ee755b6d9df3] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:13:50.827662 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-4c5cd380-7647-4e9c-9663-a5b388dda318 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:50.828144 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-4c5cd380-7647-4e9c-9663-a5b388dda318 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:50.828773 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-4c5cd380-7647-4e9c-9663-a5b388dda318 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:50.829635 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-4c5cd380-7647-4e9c-9663-a5b388dda318 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:50.830385 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-4c5cd380-7647-4e9c-9663-a5b388dda318 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:50.831039 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-4c5cd380-7647-4e9c-9663-a5b388dda318 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:50.963168 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-4c5cd380-7647-4e9c-9663-a5b388dda318 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58fbb2d79954020aa1328ef6bf925e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b87c159313f74c77a95172124e82dc25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:13:50.967274 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG dbcounter [-] [118886] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:13:50.972538 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-4c5cd380-7647-4e9c-9663-a5b388dda318 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] 10.222.0.27 "GET /compute/v2.1/servers/9f85118d-4e33-45e1-9dc6-ee755b6d9df3" status: 200 len: 1503 microversion: 2.1 time: 0.158780 Oct 17 03:13:50.973123 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 177/331] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:13:50 2022] GET /compute/v2.1/servers/9f85118d-4e33-45e1-9dc6-ee755b6d9df3 => generated 1503 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:13:51.101612 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-505d0939-1699-4cc0-ab70-cc4ff1995fac tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:13:51.102236 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-505d0939-1699-4cc0-ab70-cc4ff1995fac tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 603ee2bf-bedf-4688-ac0a-77a2a50f33d7] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:13:51.108351 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-505d0939-1699-4cc0-ab70-cc4ff1995fac tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:51.108840 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-505d0939-1699-4cc0-ab70-cc4ff1995fac tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:51.109275 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-505d0939-1699-4cc0-ab70-cc4ff1995fac tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:51.110050 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-505d0939-1699-4cc0-ab70-cc4ff1995fac tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:51.110629 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-505d0939-1699-4cc0-ab70-cc4ff1995fac tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:51.111177 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-505d0939-1699-4cc0-ab70-cc4ff1995fac tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:51.333081 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-505d0939-1699-4cc0-ab70-cc4ff1995fac tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:13:51.342187 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-505d0939-1699-4cc0-ab70-cc4ff1995fac tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:13:51.343701 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-505d0939-1699-4cc0-ab70-cc4ff1995fac tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:13:51.344923 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-505d0939-1699-4cc0-ab70-cc4ff1995fac tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7" status: 200 len: 1724 microversion: 2.20 time: 0.247392 Oct 17 03:13:51.345465 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 155/332] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 03:13:51 2022] GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7 => generated 1724 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:13:51.686587 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [req-9c22fd6c-5ee7-41a6-8d70-6ab806e7607d req-c854bd65-b74b-4310-a064-3d53d998e90f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f85118d-4e33-45e1-9dc6-ee755b6d9df3", "name": "network-vif-deleted", "tag": "a058c34f-585b-4f34-a8f2-ddf3be0cb87e"}]} {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:13:51.700621 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [req-9c22fd6c-5ee7-41a6-8d70-6ab806e7607d req-c854bd65-b74b-4310-a064-3d53d998e90f service nova] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:51.701134 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [req-9c22fd6c-5ee7-41a6-8d70-6ab806e7607d req-c854bd65-b74b-4310-a064-3d53d998e90f service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:51.701610 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [req-9c22fd6c-5ee7-41a6-8d70-6ab806e7607d req-c854bd65-b74b-4310-a064-3d53d998e90f service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:51.715468 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.compute.server_external_events [req-9c22fd6c-5ee7-41a6-8d70-6ab806e7607d req-c854bd65-b74b-4310-a064-3d53d998e90f service nova] Creating event network-vif-deleted:a058c34f-585b-4f34-a8f2-ddf3be0cb87e for instance 9f85118d-4e33-45e1-9dc6-ee755b6d9df3 on hv-cinder-84697 Oct 17 03:13:51.718985 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-76e08d3a-ae7a-411d-b19a-227c75ae8908 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:13:51.719860 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-76e08d3a-ae7a-411d-b19a-227c75ae8908 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: 90f2768b-8259-439c-af06-7eff342615ee] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:13:51.720673 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [req-9c22fd6c-5ee7-41a6-8d70-6ab806e7607d req-c854bd65-b74b-4310-a064-3d53d998e90f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038093 Oct 17 03:13:51.721259 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 178/333] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 03:13:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:13:51.727364 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-76e08d3a-ae7a-411d-b19a-227c75ae8908 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:51.728019 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-76e08d3a-ae7a-411d-b19a-227c75ae8908 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:51.728643 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-76e08d3a-ae7a-411d-b19a-227c75ae8908 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:51.729381 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-76e08d3a-ae7a-411d-b19a-227c75ae8908 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:51.729848 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-76e08d3a-ae7a-411d-b19a-227c75ae8908 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:51.730282 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-76e08d3a-ae7a-411d-b19a-227c75ae8908 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:51.879369 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-76e08d3a-ae7a-411d-b19a-227c75ae8908 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1787a9ef7c44e28076aaa80c0152fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee21a91b84794e80b208fe72b7f1e010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:13:51.892775 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-76e08d3a-ae7a-411d-b19a-227c75ae8908 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "GET /compute/v2.1/servers/90f2768b-8259-439c-af06-7eff342615ee" status: 200 len: 1522 microversion: 2.1 time: 0.177773 Oct 17 03:13:51.894832 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 156/334] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:13:51 2022] GET /compute/v2.1/servers/90f2768b-8259-439c-af06-7eff342615ee => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:13:51.999219 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-8804caad-5bc3-440c-8533-c52c7bdc8691 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:13:52.000011 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-8804caad-5bc3-440c-8533-c52c7bdc8691 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] [instance: 9f85118d-4e33-45e1-9dc6-ee755b6d9df3] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:13:52.006298 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-8804caad-5bc3-440c-8533-c52c7bdc8691 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:52.006903 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-8804caad-5bc3-440c-8533-c52c7bdc8691 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:52.008145 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-8804caad-5bc3-440c-8533-c52c7bdc8691 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:52.009375 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-8804caad-5bc3-440c-8533-c52c7bdc8691 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:52.010030 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-8804caad-5bc3-440c-8533-c52c7bdc8691 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:52.011894 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-8804caad-5bc3-440c-8533-c52c7bdc8691 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:52.091152 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-8804caad-5bc3-440c-8533-c52c7bdc8691 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58fbb2d79954020aa1328ef6bf925e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b87c159313f74c77a95172124e82dc25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:13:52.101022 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-8804caad-5bc3-440c-8533-c52c7bdc8691 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] 10.222.0.27 "GET /compute/v2.1/servers/9f85118d-4e33-45e1-9dc6-ee755b6d9df3" status: 200 len: 1299 microversion: 2.1 time: 0.107752 Oct 17 03:13:52.116532 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 179/335] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:13:51 2022] GET /compute/v2.1/servers/9f85118d-4e33-45e1-9dc6-ee755b6d9df3 => generated 1299 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:13:52.160091 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-09fff84d-76b7-4c3b-a919-850ead637c40 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1b24c1f9-2b57-48f7-9451-6cd036f94b28", "device": "/dev/sdb"}} {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:13:52.170612 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-09fff84d-76b7-4c3b-a919-850ead637c40 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] [instance: d7fc9f01-479b-43e9-9415-fe96b7140a47] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:13:52.186537 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-09fff84d-76b7-4c3b-a919-850ead637c40 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:52.187114 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-09fff84d-76b7-4c3b-a919-850ead637c40 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:52.187660 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-09fff84d-76b7-4c3b-a919-850ead637c40 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:52.188429 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-09fff84d-76b7-4c3b-a919-850ead637c40 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:52.190277 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-09fff84d-76b7-4c3b-a919-850ead637c40 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:52.190820 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-09fff84d-76b7-4c3b-a919-850ead637c40 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:52.373604 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-d28a490a-b26c-4bff-9353-34728ad851c2 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:13:52.374499 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-d28a490a-b26c-4bff-9353-34728ad851c2 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 603ee2bf-bedf-4688-ac0a-77a2a50f33d7] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:13:52.383554 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-d28a490a-b26c-4bff-9353-34728ad851c2 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:52.384452 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-d28a490a-b26c-4bff-9353-34728ad851c2 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:52.385121 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-d28a490a-b26c-4bff-9353-34728ad851c2 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:52.386101 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-d28a490a-b26c-4bff-9353-34728ad851c2 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:52.386660 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-d28a490a-b26c-4bff-9353-34728ad851c2 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:52.387270 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-d28a490a-b26c-4bff-9353-34728ad851c2 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:52.529509 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-09fff84d-76b7-4c3b-a919-850ead637c40 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] 10.222.0.27 "POST /compute/v2.1/servers/d7fc9f01-479b-43e9-9415-fe96b7140a47/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.383497 Oct 17 03:13:52.530119 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 157/336] 10.222.0.27 () {60 vars in 1323 bytes} [Mon Oct 17 03:13:52 2022] POST /compute/v2.1/servers/d7fc9f01-479b-43e9-9415-fe96b7140a47/os-volume_attachments => generated 194 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:13:52.585096 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-d28a490a-b26c-4bff-9353-34728ad851c2 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:13:52.599131 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-d28a490a-b26c-4bff-9353-34728ad851c2 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:13:52.599131 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-d28a490a-b26c-4bff-9353-34728ad851c2 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:13:52.599131 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-d28a490a-b26c-4bff-9353-34728ad851c2 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7" status: 200 len: 1724 microversion: 2.20 time: 0.228691 Oct 17 03:13:52.599479 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 180/337] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 03:13:52 2022] GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7 => generated 1724 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 03:13:52.922345 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-6b7eee29-8842-432f-8479-8f3f8f6e5c6c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:13:52.923088 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-6b7eee29-8842-432f-8479-8f3f8f6e5c6c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: 90f2768b-8259-439c-af06-7eff342615ee] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:13:52.930753 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-6b7eee29-8842-432f-8479-8f3f8f6e5c6c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:52.931273 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-6b7eee29-8842-432f-8479-8f3f8f6e5c6c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:52.931709 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-6b7eee29-8842-432f-8479-8f3f8f6e5c6c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:52.932412 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-6b7eee29-8842-432f-8479-8f3f8f6e5c6c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:52.932864 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-6b7eee29-8842-432f-8479-8f3f8f6e5c6c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:52.933286 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-6b7eee29-8842-432f-8479-8f3f8f6e5c6c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:53.074520 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-6b7eee29-8842-432f-8479-8f3f8f6e5c6c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1787a9ef7c44e28076aaa80c0152fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee21a91b84794e80b208fe72b7f1e010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:13:53.082228 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-6b7eee29-8842-432f-8479-8f3f8f6e5c6c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "GET /compute/v2.1/servers/90f2768b-8259-439c-af06-7eff342615ee" status: 200 len: 1522 microversion: 2.1 time: 0.164975 Oct 17 03:13:53.082802 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 158/338] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:13:52 2022] GET /compute/v2.1/servers/90f2768b-8259-439c-af06-7eff342615ee => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:13:53.125112 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-030729aa-d1bb-417a-9c29-db386e800253 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:13:53.126387 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-030729aa-d1bb-417a-9c29-db386e800253 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] [instance: 9f85118d-4e33-45e1-9dc6-ee755b6d9df3] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:13:53.133376 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-030729aa-d1bb-417a-9c29-db386e800253 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:53.133955 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-030729aa-d1bb-417a-9c29-db386e800253 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:53.134533 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-030729aa-d1bb-417a-9c29-db386e800253 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:53.135435 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-030729aa-d1bb-417a-9c29-db386e800253 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:53.135923 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-030729aa-d1bb-417a-9c29-db386e800253 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:53.136442 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-030729aa-d1bb-417a-9c29-db386e800253 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:53.151771 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.wsgi [None req-030729aa-d1bb-417a-9c29-db386e800253 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] HTTP exception thrown: Instance 9f85118d-4e33-45e1-9dc6-ee755b6d9df3 could not be found. Oct 17 03:13:53.154346 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-030729aa-d1bb-417a-9c29-db386e800253 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Request method failure captured: Oct 17 03:13:53.154346 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: request: GET /compute/v2.1/servers/9f85118d-4e33-45e1-9dc6-ee755b6d9df3 HTTP/1.1 Oct 17 03:13:53.154346 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Accept: application/json Oct 17 03:13:53.154346 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Accept-Encoding: identity Oct 17 03:13:53.154346 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Connection: close Oct 17 03:13:53.154346 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Content-Length: 0 Oct 17 03:13:53.154346 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Content-Type: application/json Oct 17 03:13:53.154346 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Host: 10.222.0.27 Oct 17 03:13:53.154346 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Openstack-System-Scope: None Oct 17 03:13:53.154346 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: User-Agent: python-urllib3/1.26.12 Oct 17 03:13:53.154346 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Auth-Token: gAAAAABjTMg-nnIXIahbZMQx43GIrXYuxuoBJmPXPDG8dyv2na9TS8ndT3wZ-hCyWsILnvDa2e9yaN-pTDl01K-KfhHZMIxcmF7tCpVVjyeXUIrJV0Rkvw-cY-1XFWsp7gR_L2zYdYC90YsNk4yLZtq6llhWPwWkYjyGHQPCn0KDuefdIECI_ts Oct 17 03:13:53.154346 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Domain-Id: None Oct 17 03:13:53.154346 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Domain-Name: None Oct 17 03:13:53.154346 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Identity-Status: Confirmed Oct 17 03:13:53.154346 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Is-Admin-Project: True Oct 17 03:13:53.154346 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Project-Domain-Id: default Oct 17 03:13:53.154346 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Project-Domain-Name: Default Oct 17 03:13:53.154346 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Project-Id: b87c159313f74c77a95172124e82dc25 Oct 17 03:13:53.154346 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Project-Name: tempest-VolumesActionsTest-1421221816 Oct 17 03:13:53.154346 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Role: member,reader Oct 17 03:13:53.154346 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Roles: member,reader Oct 17 03:13:53.155837 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b87c159313f74c77a95172124e82dc25"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b87c159313f74c77a95172124e82dc25"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b87c159313f74c77a95172124e82dc25"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b87c159313f74c77a95172124e82dc25"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 17 03:13:53.155837 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Tenant: tempest-VolumesActionsTest-1421221816 Oct 17 03:13:53.155837 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Tenant-Id: b87c159313f74c77a95172124e82dc25 Oct 17 03:13:53.155837 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Tenant-Name: tempest-VolumesActionsTest-1421221816 Oct 17 03:13:53.155837 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-User: tempest-VolumesActionsTest-1421221816-project Oct 17 03:13:53.155837 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-User-Domain-Id: default Oct 17 03:13:53.155837 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-User-Domain-Name: Default Oct 17 03:13:53.155837 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-User-Id: c58fbb2d79954020aa1328ef6bf925e4 Oct 17 03:13:53.155837 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-User-Name: tempest-VolumesActionsTest-1421221816-project Oct 17 03:13:53.155837 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: method: > Oct 17 03:13:53.155837 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: exception: Instance 9f85118d-4e33-45e1-9dc6-ee755b6d9df3 could not be found. Oct 17 03:13:53.155837 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: action_args: {'id': '9f85118d-4e33-45e1-9dc6-ee755b6d9df3'} Oct 17 03:13:53.156613 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 03:13:53.156613 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:13:53.156613 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 03:13:53.156613 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 03:13:53.156613 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 03:13:53.156613 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 03:13:53.156613 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 03:13:53.156613 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 03:13:53.156613 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 03:13:53.156613 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 03:13:53.156613 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f85118d-4e33-45e1-9dc6-ee755b6d9df3 could not be found. Oct 17 03:13:53.156613 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Oct 17 03:13:53.156613 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:13:53.156613 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Oct 17 03:13:53.156613 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:13:53.156613 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:13:53.156613 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:13:53.156613 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 03:13:53.156613 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 03:13:53.156613 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 03:13:53.157796 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 03:13:53.157796 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 03:13:53.157796 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 03:13:53.157796 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 03:13:53.157796 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 03:13:53.157796 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 03:13:53.157796 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 03:13:53.157796 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f85118d-4e33-45e1-9dc6-ee755b6d9df3 could not be found. Oct 17 03:13:53.157796 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Oct 17 03:13:53.157796 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:13:53.157796 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Oct 17 03:13:53.157796 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:13:53.157796 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:13:53.157796 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:13:53.157796 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 03:13:53.157796 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 03:13:53.157796 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f85118d-4e33-45e1-9dc6-ee755b6d9df3 could not be found. Oct 17 03:13:53.157796 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Oct 17 03:13:53.159204 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-030729aa-d1bb-417a-9c29-db386e800253 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] Returning 404 to user: Instance 9f85118d-4e33-45e1-9dc6-ee755b6d9df3 could not be found. {{(pid=118886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 03:13:53.159204 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-030729aa-d1bb-417a-9c29-db386e800253 tempest-VolumesActionsTest-1421221816 tempest-VolumesActionsTest-1421221816-project] 10.222.0.27 "GET /compute/v2.1/servers/9f85118d-4e33-45e1-9dc6-ee755b6d9df3" status: 404 len: 111 microversion: 2.1 time: 0.035407 Oct 17 03:13:53.159204 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 181/339] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:13:53 2022] GET /compute/v2.1/servers/9f85118d-4e33-45e1-9dc6-ee755b6d9df3 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 03:13:53.625058 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-7ae6e891-6e99-40df-990d-4b60f8caddec tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:13:53.625688 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-7ae6e891-6e99-40df-990d-4b60f8caddec tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 603ee2bf-bedf-4688-ac0a-77a2a50f33d7] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:13:53.638596 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-7ae6e891-6e99-40df-990d-4b60f8caddec tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:53.642066 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-7ae6e891-6e99-40df-990d-4b60f8caddec tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:53.642563 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-7ae6e891-6e99-40df-990d-4b60f8caddec tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:53.643473 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-7ae6e891-6e99-40df-990d-4b60f8caddec tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:53.645301 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-7ae6e891-6e99-40df-990d-4b60f8caddec tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:53.663135 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-7ae6e891-6e99-40df-990d-4b60f8caddec tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:53.848112 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-7ae6e891-6e99-40df-990d-4b60f8caddec tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:13:53.899786 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-7ae6e891-6e99-40df-990d-4b60f8caddec tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:13:53.901513 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-7ae6e891-6e99-40df-990d-4b60f8caddec tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:13:53.902945 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-7ae6e891-6e99-40df-990d-4b60f8caddec tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7" status: 200 len: 1724 microversion: 2.20 time: 0.283642 Oct 17 03:13:53.903866 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 159/340] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 03:13:53 2022] GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7 => generated 1724 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:13:54.111702 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-2865758b-7451-4c54-9500-8b7ae7e2b768 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:13:54.112303 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-2865758b-7451-4c54-9500-8b7ae7e2b768 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: 90f2768b-8259-439c-af06-7eff342615ee] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:13:54.127310 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-2865758b-7451-4c54-9500-8b7ae7e2b768 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:54.129101 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-2865758b-7451-4c54-9500-8b7ae7e2b768 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:54.129748 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-2865758b-7451-4c54-9500-8b7ae7e2b768 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:54.130720 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-2865758b-7451-4c54-9500-8b7ae7e2b768 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:54.132203 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-2865758b-7451-4c54-9500-8b7ae7e2b768 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:54.133062 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-2865758b-7451-4c54-9500-8b7ae7e2b768 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:54.356984 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-2865758b-7451-4c54-9500-8b7ae7e2b768 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1787a9ef7c44e28076aaa80c0152fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee21a91b84794e80b208fe72b7f1e010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:13:54.367534 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-2865758b-7451-4c54-9500-8b7ae7e2b768 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "GET /compute/v2.1/servers/90f2768b-8259-439c-af06-7eff342615ee" status: 200 len: 1522 microversion: 2.1 time: 0.259626 Oct 17 03:13:54.368705 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 182/341] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:13:54 2022] GET /compute/v2.1/servers/90f2768b-8259-439c-af06-7eff342615ee => generated 1522 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:13:54.933269 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-0c5b97f6-83ea-4201-aea9-7ee8497a638e tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:13:54.933831 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-0c5b97f6-83ea-4201-aea9-7ee8497a638e tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 603ee2bf-bedf-4688-ac0a-77a2a50f33d7] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:13:54.939877 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-0c5b97f6-83ea-4201-aea9-7ee8497a638e tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:54.940346 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-0c5b97f6-83ea-4201-aea9-7ee8497a638e tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:54.940781 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-0c5b97f6-83ea-4201-aea9-7ee8497a638e tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:54.941473 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-0c5b97f6-83ea-4201-aea9-7ee8497a638e tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:54.941924 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-0c5b97f6-83ea-4201-aea9-7ee8497a638e tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:54.942352 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-0c5b97f6-83ea-4201-aea9-7ee8497a638e tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:55.098482 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-0c5b97f6-83ea-4201-aea9-7ee8497a638e tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:13:55.107327 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-0c5b97f6-83ea-4201-aea9-7ee8497a638e tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:13:55.108783 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-0c5b97f6-83ea-4201-aea9-7ee8497a638e tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:13:55.109939 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-0c5b97f6-83ea-4201-aea9-7ee8497a638e tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7" status: 200 len: 1724 microversion: 2.20 time: 0.180627 Oct 17 03:13:55.111911 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 160/342] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 03:13:54 2022] GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7 => generated 1724 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:13:55.391895 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-b24e2758-4ad3-4e45-9d38-0d44a03bb030 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:13:55.392605 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-b24e2758-4ad3-4e45-9d38-0d44a03bb030 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: 90f2768b-8259-439c-af06-7eff342615ee] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:13:55.401156 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-b24e2758-4ad3-4e45-9d38-0d44a03bb030 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:55.401684 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-b24e2758-4ad3-4e45-9d38-0d44a03bb030 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:55.402149 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-b24e2758-4ad3-4e45-9d38-0d44a03bb030 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:55.402855 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-b24e2758-4ad3-4e45-9d38-0d44a03bb030 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:55.403410 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-b24e2758-4ad3-4e45-9d38-0d44a03bb030 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:55.404095 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-b24e2758-4ad3-4e45-9d38-0d44a03bb030 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:55.537381 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-b24e2758-4ad3-4e45-9d38-0d44a03bb030 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1787a9ef7c44e28076aaa80c0152fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee21a91b84794e80b208fe72b7f1e010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:13:55.546121 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-b24e2758-4ad3-4e45-9d38-0d44a03bb030 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "GET /compute/v2.1/servers/90f2768b-8259-439c-af06-7eff342615ee" status: 200 len: 1522 microversion: 2.1 time: 0.158129 Oct 17 03:13:55.546798 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 183/343] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:13:55 2022] GET /compute/v2.1/servers/90f2768b-8259-439c-af06-7eff342615ee => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:13:56.140386 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-24bc6685-03e6-4241-b9eb-e73f4d1fa543 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:13:56.140951 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-24bc6685-03e6-4241-b9eb-e73f4d1fa543 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 603ee2bf-bedf-4688-ac0a-77a2a50f33d7] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:13:56.147336 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-24bc6685-03e6-4241-b9eb-e73f4d1fa543 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:56.147816 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-24bc6685-03e6-4241-b9eb-e73f4d1fa543 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:56.148241 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-24bc6685-03e6-4241-b9eb-e73f4d1fa543 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:56.148922 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-24bc6685-03e6-4241-b9eb-e73f4d1fa543 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:56.149371 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-24bc6685-03e6-4241-b9eb-e73f4d1fa543 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:56.149793 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-24bc6685-03e6-4241-b9eb-e73f4d1fa543 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:56.154080 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG dbcounter [-] [118887] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=118887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:13:56.283032 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-24bc6685-03e6-4241-b9eb-e73f4d1fa543 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:13:56.292024 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-24bc6685-03e6-4241-b9eb-e73f4d1fa543 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:13:56.293466 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-24bc6685-03e6-4241-b9eb-e73f4d1fa543 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:13:56.294604 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-24bc6685-03e6-4241-b9eb-e73f4d1fa543 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7" status: 200 len: 1724 microversion: 2.20 time: 0.158207 Oct 17 03:13:56.295186 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 161/344] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 03:13:56 2022] GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:13:56.571076 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-284f4f32-0855-46ec-a758-e71bb66cba73 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:13:56.571780 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-284f4f32-0855-46ec-a758-e71bb66cba73 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: 90f2768b-8259-439c-af06-7eff342615ee] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:13:56.579316 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-284f4f32-0855-46ec-a758-e71bb66cba73 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:56.579819 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-284f4f32-0855-46ec-a758-e71bb66cba73 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:56.580331 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-284f4f32-0855-46ec-a758-e71bb66cba73 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:56.581090 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-284f4f32-0855-46ec-a758-e71bb66cba73 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:56.581834 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-284f4f32-0855-46ec-a758-e71bb66cba73 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:56.582256 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-284f4f32-0855-46ec-a758-e71bb66cba73 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:56.713001 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-284f4f32-0855-46ec-a758-e71bb66cba73 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1787a9ef7c44e28076aaa80c0152fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee21a91b84794e80b208fe72b7f1e010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:13:56.720724 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-284f4f32-0855-46ec-a758-e71bb66cba73 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "GET /compute/v2.1/servers/90f2768b-8259-439c-af06-7eff342615ee" status: 200 len: 1522 microversion: 2.1 time: 0.154551 Oct 17 03:13:56.721282 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 184/345] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:13:56 2022] GET /compute/v2.1/servers/90f2768b-8259-439c-af06-7eff342615ee => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:13:57.321372 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-270287b4-e6ac-45b8-8b0b-63d78954990d tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:13:57.321965 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-270287b4-e6ac-45b8-8b0b-63d78954990d tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 603ee2bf-bedf-4688-ac0a-77a2a50f33d7] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:13:57.328307 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-270287b4-e6ac-45b8-8b0b-63d78954990d tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:57.328802 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-270287b4-e6ac-45b8-8b0b-63d78954990d tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:57.329276 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-270287b4-e6ac-45b8-8b0b-63d78954990d tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:57.329959 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-270287b4-e6ac-45b8-8b0b-63d78954990d tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:57.330445 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-270287b4-e6ac-45b8-8b0b-63d78954990d tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:57.330881 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-270287b4-e6ac-45b8-8b0b-63d78954990d tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:57.464958 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-270287b4-e6ac-45b8-8b0b-63d78954990d tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:13:57.472923 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-270287b4-e6ac-45b8-8b0b-63d78954990d tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:13:57.474506 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-270287b4-e6ac-45b8-8b0b-63d78954990d tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:13:57.475745 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-270287b4-e6ac-45b8-8b0b-63d78954990d tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7" status: 200 len: 1724 microversion: 2.20 time: 0.158257 Oct 17 03:13:57.476301 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 162/346] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 03:13:57 2022] GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:13:57.744185 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-946f7e60-12a2-49b1-8351-be3be31e243c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:13:57.744820 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-946f7e60-12a2-49b1-8351-be3be31e243c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: 90f2768b-8259-439c-af06-7eff342615ee] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:13:57.752116 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-946f7e60-12a2-49b1-8351-be3be31e243c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:57.752673 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-946f7e60-12a2-49b1-8351-be3be31e243c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:57.753232 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-946f7e60-12a2-49b1-8351-be3be31e243c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:57.754417 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-946f7e60-12a2-49b1-8351-be3be31e243c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:57.754991 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-946f7e60-12a2-49b1-8351-be3be31e243c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:57.755961 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-946f7e60-12a2-49b1-8351-be3be31e243c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:57.892681 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-946f7e60-12a2-49b1-8351-be3be31e243c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1787a9ef7c44e28076aaa80c0152fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee21a91b84794e80b208fe72b7f1e010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:13:57.901479 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-946f7e60-12a2-49b1-8351-be3be31e243c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "GET /compute/v2.1/servers/90f2768b-8259-439c-af06-7eff342615ee" status: 200 len: 1522 microversion: 2.1 time: 0.162203 Oct 17 03:13:57.902115 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 185/347] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:13:57 2022] GET /compute/v2.1/servers/90f2768b-8259-439c-af06-7eff342615ee => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:13:58.504088 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-227290aa-9aeb-4815-9e44-d6440b2e4166 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:13:58.506084 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-227290aa-9aeb-4815-9e44-d6440b2e4166 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 603ee2bf-bedf-4688-ac0a-77a2a50f33d7] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:13:58.515881 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-227290aa-9aeb-4815-9e44-d6440b2e4166 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:58.516420 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-227290aa-9aeb-4815-9e44-d6440b2e4166 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:58.516940 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-227290aa-9aeb-4815-9e44-d6440b2e4166 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:58.517957 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-227290aa-9aeb-4815-9e44-d6440b2e4166 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:58.518479 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-227290aa-9aeb-4815-9e44-d6440b2e4166 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:58.518938 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-227290aa-9aeb-4815-9e44-d6440b2e4166 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:58.688630 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-227290aa-9aeb-4815-9e44-d6440b2e4166 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:13:58.698581 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-227290aa-9aeb-4815-9e44-d6440b2e4166 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:13:58.700238 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-227290aa-9aeb-4815-9e44-d6440b2e4166 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:13:58.701776 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-227290aa-9aeb-4815-9e44-d6440b2e4166 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7" status: 200 len: 1724 microversion: 2.20 time: 0.204119 Oct 17 03:13:58.702854 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 163/348] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 03:13:58 2022] GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7 => generated 1724 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:13:58.925243 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-9d89cc76-45a1-4184-90f0-3d561ce4a9db tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:13:58.926129 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-9d89cc76-45a1-4184-90f0-3d561ce4a9db tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: 90f2768b-8259-439c-af06-7eff342615ee] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:13:58.933538 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-9d89cc76-45a1-4184-90f0-3d561ce4a9db tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:58.934103 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-9d89cc76-45a1-4184-90f0-3d561ce4a9db tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:58.934727 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-9d89cc76-45a1-4184-90f0-3d561ce4a9db tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:58.935453 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-9d89cc76-45a1-4184-90f0-3d561ce4a9db tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:58.936365 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-9d89cc76-45a1-4184-90f0-3d561ce4a9db tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:58.937035 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-9d89cc76-45a1-4184-90f0-3d561ce4a9db tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:59.108927 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-9d89cc76-45a1-4184-90f0-3d561ce4a9db tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1787a9ef7c44e28076aaa80c0152fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee21a91b84794e80b208fe72b7f1e010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:13:59.118103 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-9d89cc76-45a1-4184-90f0-3d561ce4a9db tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "GET /compute/v2.1/servers/90f2768b-8259-439c-af06-7eff342615ee" status: 200 len: 1522 microversion: 2.1 time: 0.196995 Oct 17 03:13:59.119007 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 186/349] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:13:58 2022] GET /compute/v2.1/servers/90f2768b-8259-439c-af06-7eff342615ee => generated 1522 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:13:59.728019 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-2562ca2d-db42-4a44-8571-1d6f5b95309a tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:13:59.729917 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-2562ca2d-db42-4a44-8571-1d6f5b95309a tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 603ee2bf-bedf-4688-ac0a-77a2a50f33d7] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:13:59.737047 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-2562ca2d-db42-4a44-8571-1d6f5b95309a tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:59.737669 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-2562ca2d-db42-4a44-8571-1d6f5b95309a tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:59.738428 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-2562ca2d-db42-4a44-8571-1d6f5b95309a tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:59.739601 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-2562ca2d-db42-4a44-8571-1d6f5b95309a tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:13:59.740338 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-2562ca2d-db42-4a44-8571-1d6f5b95309a tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:13:59.740864 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-2562ca2d-db42-4a44-8571-1d6f5b95309a tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:13:59.908266 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-2562ca2d-db42-4a44-8571-1d6f5b95309a tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:13:59.917308 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-2562ca2d-db42-4a44-8571-1d6f5b95309a tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:13:59.918753 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-2562ca2d-db42-4a44-8571-1d6f5b95309a tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:13:59.920053 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-2562ca2d-db42-4a44-8571-1d6f5b95309a tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7" status: 200 len: 1724 microversion: 2.20 time: 0.196786 Oct 17 03:13:59.920824 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 164/350] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 03:13:59 2022] GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7 => generated 1724 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:14:00.144439 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-2f758157-437e-4e2b-b337-b9b85bf66859 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:14:00.145643 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-2f758157-437e-4e2b-b337-b9b85bf66859 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: 90f2768b-8259-439c-af06-7eff342615ee] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:14:00.159850 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-2f758157-437e-4e2b-b337-b9b85bf66859 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:00.160572 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-2f758157-437e-4e2b-b337-b9b85bf66859 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:00.161300 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-2f758157-437e-4e2b-b337-b9b85bf66859 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:00.162408 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-2f758157-437e-4e2b-b337-b9b85bf66859 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:00.162889 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-2f758157-437e-4e2b-b337-b9b85bf66859 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:00.163312 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-2f758157-437e-4e2b-b337-b9b85bf66859 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:00.371890 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-2f758157-437e-4e2b-b337-b9b85bf66859 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1787a9ef7c44e28076aaa80c0152fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee21a91b84794e80b208fe72b7f1e010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:00.387444 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-2f758157-437e-4e2b-b337-b9b85bf66859 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "GET /compute/v2.1/servers/90f2768b-8259-439c-af06-7eff342615ee" status: 200 len: 1522 microversion: 2.1 time: 0.246807 Oct 17 03:14:00.389083 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 187/351] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:14:00 2022] GET /compute/v2.1/servers/90f2768b-8259-439c-af06-7eff342615ee => generated 1522 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:14:00.949098 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-3508ba22-c5a4-4681-a1ac-a00ce25eb47a tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:14:00.949986 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-3508ba22-c5a4-4681-a1ac-a00ce25eb47a tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 603ee2bf-bedf-4688-ac0a-77a2a50f33d7] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:14:00.958412 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-3508ba22-c5a4-4681-a1ac-a00ce25eb47a tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:00.959337 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-3508ba22-c5a4-4681-a1ac-a00ce25eb47a tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:00.960185 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-3508ba22-c5a4-4681-a1ac-a00ce25eb47a tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:00.962560 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-3508ba22-c5a4-4681-a1ac-a00ce25eb47a tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:00.962560 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-3508ba22-c5a4-4681-a1ac-a00ce25eb47a tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:00.962560 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-3508ba22-c5a4-4681-a1ac-a00ce25eb47a tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:01.155991 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-3508ba22-c5a4-4681-a1ac-a00ce25eb47a tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:01.165018 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-3508ba22-c5a4-4681-a1ac-a00ce25eb47a tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:01.166484 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-3508ba22-c5a4-4681-a1ac-a00ce25eb47a tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:01.167888 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-3508ba22-c5a4-4681-a1ac-a00ce25eb47a tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7" status: 200 len: 1724 microversion: 2.20 time: 0.225184 Oct 17 03:14:01.171515 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 165/352] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 03:14:00 2022] GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7 => generated 1724 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 03:14:01.413284 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-1fc6cbb1-2f28-4df7-8315-b632830f415d tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:14:01.415277 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-1fc6cbb1-2f28-4df7-8315-b632830f415d tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: 90f2768b-8259-439c-af06-7eff342615ee] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:14:01.423570 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-1fc6cbb1-2f28-4df7-8315-b632830f415d tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:01.424587 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-1fc6cbb1-2f28-4df7-8315-b632830f415d tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:01.425433 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-1fc6cbb1-2f28-4df7-8315-b632830f415d tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:01.426521 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-1fc6cbb1-2f28-4df7-8315-b632830f415d tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:01.427648 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-1fc6cbb1-2f28-4df7-8315-b632830f415d tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:01.442077 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-1fc6cbb1-2f28-4df7-8315-b632830f415d tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:01.635429 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-1fc6cbb1-2f28-4df7-8315-b632830f415d tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1787a9ef7c44e28076aaa80c0152fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee21a91b84794e80b208fe72b7f1e010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:01.645533 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-1fc6cbb1-2f28-4df7-8315-b632830f415d tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "GET /compute/v2.1/servers/90f2768b-8259-439c-af06-7eff342615ee" status: 200 len: 1522 microversion: 2.1 time: 0.237572 Oct 17 03:14:01.647828 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 188/353] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:14:01 2022] GET /compute/v2.1/servers/90f2768b-8259-439c-af06-7eff342615ee => generated 1522 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:14:02.223263 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-20aec605-1406-4b6e-84cd-1e9ee17ed859 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:14:02.225526 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-20aec605-1406-4b6e-84cd-1e9ee17ed859 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 603ee2bf-bedf-4688-ac0a-77a2a50f33d7] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:14:02.244889 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-20aec605-1406-4b6e-84cd-1e9ee17ed859 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:02.246053 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-20aec605-1406-4b6e-84cd-1e9ee17ed859 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:02.246776 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-20aec605-1406-4b6e-84cd-1e9ee17ed859 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:02.250311 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-20aec605-1406-4b6e-84cd-1e9ee17ed859 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:02.255242 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-20aec605-1406-4b6e-84cd-1e9ee17ed859 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:02.255923 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-20aec605-1406-4b6e-84cd-1e9ee17ed859 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:02.502769 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-20aec605-1406-4b6e-84cd-1e9ee17ed859 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:02.511412 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-20aec605-1406-4b6e-84cd-1e9ee17ed859 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:02.516497 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-20aec605-1406-4b6e-84cd-1e9ee17ed859 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:02.518535 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-20aec605-1406-4b6e-84cd-1e9ee17ed859 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7" status: 200 len: 1724 microversion: 2.20 time: 0.305748 Oct 17 03:14:02.519318 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 166/354] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 03:14:02 2022] GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7 => generated 1724 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:14:02.658671 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-67eac741-d76c-466c-a188-f5c341f908f2 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:14:02.671037 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-67eac741-d76c-466c-a188-f5c341f908f2 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:02.671799 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-67eac741-d76c-466c-a188-f5c341f908f2 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:02.671971 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-b34f6828-5ef7-42f6-88a8-eca354e47ca9 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:14:02.672573 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-b34f6828-5ef7-42f6-88a8-eca354e47ca9 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: 90f2768b-8259-439c-af06-7eff342615ee] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:14:02.672677 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-67eac741-d76c-466c-a188-f5c341f908f2 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:02.682039 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-b34f6828-5ef7-42f6-88a8-eca354e47ca9 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:02.682625 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-b34f6828-5ef7-42f6-88a8-eca354e47ca9 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:02.683105 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-b34f6828-5ef7-42f6-88a8-eca354e47ca9 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:02.683786 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-b34f6828-5ef7-42f6-88a8-eca354e47ca9 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:02.684408 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-b34f6828-5ef7-42f6-88a8-eca354e47ca9 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:02.685056 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-b34f6828-5ef7-42f6-88a8-eca354e47ca9 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:02.756899 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-67eac741-d76c-466c-a188-f5c341f908f2 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] [instance: 7b220b35-d9ac-48e4-b898-3d4f6c7be835] Going to try to stop instance {{(pid=118886) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 17 03:14:02.820172 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-67eac741-d76c-466c-a188-f5c341f908f2 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] 10.222.0.27 "POST /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835/action" status: 202 len: 0 microversion: 2.1 time: 0.165649 Oct 17 03:14:02.821479 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 189/355] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 03:14:02 2022] POST /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835/action => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 03:14:02.834171 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-7f32368f-2339-4576-b9fa-2ad79a98ca44 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:14:02.835258 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-7f32368f-2339-4576-b9fa-2ad79a98ca44 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] [instance: 7b220b35-d9ac-48e4-b898-3d4f6c7be835] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:14:02.844136 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-7f32368f-2339-4576-b9fa-2ad79a98ca44 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:02.845329 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-7f32368f-2339-4576-b9fa-2ad79a98ca44 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:02.846101 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-7f32368f-2339-4576-b9fa-2ad79a98ca44 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:02.847117 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-7f32368f-2339-4576-b9fa-2ad79a98ca44 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:02.847772 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-7f32368f-2339-4576-b9fa-2ad79a98ca44 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:02.853351 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-7f32368f-2339-4576-b9fa-2ad79a98ca44 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:02.864466 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-b34f6828-5ef7-42f6-88a8-eca354e47ca9 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1787a9ef7c44e28076aaa80c0152fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee21a91b84794e80b208fe72b7f1e010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:02.872730 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-b34f6828-5ef7-42f6-88a8-eca354e47ca9 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "GET /compute/v2.1/servers/90f2768b-8259-439c-af06-7eff342615ee" status: 200 len: 1502 microversion: 2.1 time: 0.204534 Oct 17 03:14:02.873894 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 167/356] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:14:02 2022] GET /compute/v2.1/servers/90f2768b-8259-439c-af06-7eff342615ee => generated 1502 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:14:02.897843 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-5fa3c92f-950b-489e-868c-d857bd7b4185 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a929d38a-7a2d-4fc4-ab11-f24c476bf53a"}} {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:14:02.901096 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-5fa3c92f-950b-489e-868c-d857bd7b4185 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: 90f2768b-8259-439c-af06-7eff342615ee] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:14:02.913224 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-5fa3c92f-950b-489e-868c-d857bd7b4185 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:02.913723 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-5fa3c92f-950b-489e-868c-d857bd7b4185 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:02.914167 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-5fa3c92f-950b-489e-868c-d857bd7b4185 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:02.915277 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-5fa3c92f-950b-489e-868c-d857bd7b4185 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:02.915896 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-5fa3c92f-950b-489e-868c-d857bd7b4185 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:02.916481 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-5fa3c92f-950b-489e-868c-d857bd7b4185 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:02.947722 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.wsgi [None req-5fa3c92f-950b-489e-868c-d857bd7b4185 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] HTTP exception thrown: Cannot 'attach_volume' instance 90f2768b-8259-439c-af06-7eff342615ee while it is in vm_state rescued Oct 17 03:14:02.952966 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-5fa3c92f-950b-489e-868c-d857bd7b4185 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Request method failure captured: Oct 17 03:14:02.952966 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: request: POST /compute/v2.1/servers/90f2768b-8259-439c-af06-7eff342615ee/os-volume_attachments HTTP/1.1 Oct 17 03:14:02.952966 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Accept: application/json Oct 17 03:14:02.952966 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Accept-Encoding: identity Oct 17 03:14:02.952966 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Connection: close Oct 17 03:14:02.952966 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Content-Length: 74 Oct 17 03:14:02.952966 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Content-Type: application/json Oct 17 03:14:02.952966 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Host: 10.222.0.27 Oct 17 03:14:02.952966 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Openstack-System-Scope: None Oct 17 03:14:02.952966 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: User-Agent: python-urllib3/1.26.12 Oct 17 03:14:02.952966 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Auth-Token: gAAAAABjTMf8n_6_Hk42-LQ3323zf7rLyhBkZ7TzI7iXmOD1LZOLQulk-a15ge0ewasywiXZ0G3F3f55kCah96aeBj6-Tg6x0QhgUp1XcnGW8u5zIwcRB_iergkiw_PISrGg1NTyyTzxZ2mz7vHEvQ-8c7ZO9C6TeQ_1FzcAq2bYh8NgMR7sjzA Oct 17 03:14:02.952966 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Domain-Id: None Oct 17 03:14:02.952966 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Domain-Name: None Oct 17 03:14:02.952966 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Identity-Status: Confirmed Oct 17 03:14:02.952966 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Is-Admin-Project: True Oct 17 03:14:02.952966 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Project-Domain-Id: default Oct 17 03:14:02.952966 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Project-Domain-Name: Default Oct 17 03:14:02.952966 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Project-Id: ee21a91b84794e80b208fe72b7f1e010 Oct 17 03:14:02.952966 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1171271233 Oct 17 03:14:02.952966 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Role: member,reader Oct 17 03:14:02.952966 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Roles: member,reader Oct 17 03:14:02.954674 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ee21a91b84794e80b208fe72b7f1e010"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ee21a91b84794e80b208fe72b7f1e010"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ee21a91b84794e80b208fe72b7f1e010"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ee21a91b84794e80b208fe72b7f1e010"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 17 03:14:02.954674 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1171271233 Oct 17 03:14:02.954674 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Tenant-Id: ee21a91b84794e80b208fe72b7f1e010 Oct 17 03:14:02.954674 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1171271233 Oct 17 03:14:02.954674 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-User: tempest-ServerRescueNegativeTestJSON-1171271233-project Oct 17 03:14:02.954674 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-User-Domain-Id: default Oct 17 03:14:02.954674 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-User-Domain-Name: Default Oct 17 03:14:02.954674 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-User-Id: 9c1787a9ef7c44e28076aaa80c0152fd Oct 17 03:14:02.954674 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1171271233-project Oct 17 03:14:02.954674 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Oct 17 03:14:02.954674 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: {"volumeAttachment": {"volumeId": "a929d38a-7a2d-4fc4-ab11-f24c476bf53a"}} Oct 17 03:14:02.954674 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: method: > Oct 17 03:14:02.955537 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: exception: Cannot 'attach_volume' instance 90f2768b-8259-439c-af06-7eff342615ee while it is in vm_state rescued Oct 17 03:14:02.955537 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: action_args: {'server_id': '90f2768b-8259-439c-af06-7eff342615ee', 'body': {'volumeAttachment': {'volumeId': 'a929d38a-7a2d-4fc4-ab11-f24c476bf53a'}}} Oct 17 03:14:02.955537 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 03:14:02.955537 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:14:02.955537 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 17 03:14:02.955537 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 17 03:14:02.955537 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 17 03:14:02.955537 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 17 03:14:02.955537 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 17 03:14:02.955537 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 17 03:14:02.955537 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 90f2768b-8259-439c-af06-7eff342615ee in vm_state rescued. Cannot attach_volume while the instance is in this state. Oct 17 03:14:02.955537 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Oct 17 03:14:02.955537 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:14:02.955537 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Oct 17 03:14:02.955537 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:14:02.955537 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:14:02.955537 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:14:02.955537 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 03:14:02.955537 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 03:14:02.956709 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 03:14:02.956709 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 03:14:02.956709 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 03:14:02.956709 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 03:14:02.956709 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 03:14:02.956709 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 03:14:02.956709 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 03:14:02.956709 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 03:14:02.956709 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Oct 17 03:14:02.956709 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 17 03:14:02.956709 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 17 03:14:02.956709 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 17 03:14:02.956709 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 90f2768b-8259-439c-af06-7eff342615ee while it is in vm_state rescued Oct 17 03:14:02.956709 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Oct 17 03:14:02.956709 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:14:02.956709 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Oct 17 03:14:02.956709 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:14:02.956709 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:14:02.956709 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:14:02.957820 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 03:14:02.957820 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 03:14:02.957820 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 90f2768b-8259-439c-af06-7eff342615ee while it is in vm_state rescued Oct 17 03:14:02.957820 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Oct 17 03:14:02.957820 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-5fa3c92f-950b-489e-868c-d857bd7b4185 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Returning 409 to user: Cannot 'attach_volume' instance 90f2768b-8259-439c-af06-7eff342615ee while it is in vm_state rescued {{(pid=118887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 03:14:02.957820 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-5fa3c92f-950b-489e-868c-d857bd7b4185 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "POST /compute/v2.1/servers/90f2768b-8259-439c-af06-7eff342615ee/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.061840 Oct 17 03:14:02.957820 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 168/357] 10.222.0.27 () {60 vars in 1323 bytes} [Mon Oct 17 03:14:02 2022] POST /compute/v2.1/servers/90f2768b-8259-439c-af06-7eff342615ee/os-volume_attachments => generated 152 bytes in 63 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 17 03:14:02.965873 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-f14d6e19-0e14-47e6-8dc2-c869c37bdfb1 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:14:02.966599 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-f14d6e19-0e14-47e6-8dc2-c869c37bdfb1 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: 90f2768b-8259-439c-af06-7eff342615ee] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:14:02.973715 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-f14d6e19-0e14-47e6-8dc2-c869c37bdfb1 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:02.975103 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-f14d6e19-0e14-47e6-8dc2-c869c37bdfb1 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:02.975614 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-f14d6e19-0e14-47e6-8dc2-c869c37bdfb1 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:02.976385 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-f14d6e19-0e14-47e6-8dc2-c869c37bdfb1 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:02.977141 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-f14d6e19-0e14-47e6-8dc2-c869c37bdfb1 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:02.977579 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-f14d6e19-0e14-47e6-8dc2-c869c37bdfb1 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:03.057022 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-7f32368f-2339-4576-b9fa-2ad79a98ca44 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce25db99a7b14d0bbaca41fff80e3da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5bad80dc0d74119b2a9cd5c1935e8d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:03.066282 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-7f32368f-2339-4576-b9fa-2ad79a98ca44 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] 10.222.0.27 "GET /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835" status: 200 len: 1725 microversion: 2.1 time: 0.240452 Oct 17 03:14:03.067165 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 190/358] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:14:02 2022] GET /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835 => generated 1725 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:14:03.071047 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-f14d6e19-0e14-47e6-8dc2-c869c37bdfb1 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "POST /compute/v2.1/servers/90f2768b-8259-439c-af06-7eff342615ee/action" status: 202 len: 0 microversion: 2.1 time: 0.106018 Oct 17 03:14:03.071047 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 169/359] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 03:14:02 2022] POST /compute/v2.1/servers/90f2768b-8259-439c-af06-7eff342615ee/action => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 03:14:03.078241 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-782ef3e7-0b62-4b24-a5ed-677c5ea4fe2c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:14:03.079162 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-782ef3e7-0b62-4b24-a5ed-677c5ea4fe2c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: 90f2768b-8259-439c-af06-7eff342615ee] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:14:03.086901 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-782ef3e7-0b62-4b24-a5ed-677c5ea4fe2c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:03.087702 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-782ef3e7-0b62-4b24-a5ed-677c5ea4fe2c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:03.088314 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-782ef3e7-0b62-4b24-a5ed-677c5ea4fe2c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:03.089020 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-782ef3e7-0b62-4b24-a5ed-677c5ea4fe2c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:03.089474 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-782ef3e7-0b62-4b24-a5ed-677c5ea4fe2c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:03.089903 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-782ef3e7-0b62-4b24-a5ed-677c5ea4fe2c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:03.260916 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-782ef3e7-0b62-4b24-a5ed-677c5ea4fe2c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1787a9ef7c44e28076aaa80c0152fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee21a91b84794e80b208fe72b7f1e010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:03.269796 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-782ef3e7-0b62-4b24-a5ed-677c5ea4fe2c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "GET /compute/v2.1/servers/90f2768b-8259-439c-af06-7eff342615ee" status: 200 len: 1510 microversion: 2.1 time: 0.196189 Oct 17 03:14:03.270493 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 170/360] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:14:03 2022] GET /compute/v2.1/servers/90f2768b-8259-439c-af06-7eff342615ee => generated 1510 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:14:03.553250 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-6ff2ceb0-6e20-44d9-9cb6-75d467276624 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:14:03.554597 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-6ff2ceb0-6e20-44d9-9cb6-75d467276624 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 603ee2bf-bedf-4688-ac0a-77a2a50f33d7] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:14:03.579169 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-6ff2ceb0-6e20-44d9-9cb6-75d467276624 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:03.580010 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-6ff2ceb0-6e20-44d9-9cb6-75d467276624 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:03.581743 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-6ff2ceb0-6e20-44d9-9cb6-75d467276624 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:03.585247 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-6ff2ceb0-6e20-44d9-9cb6-75d467276624 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:03.587135 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-6ff2ceb0-6e20-44d9-9cb6-75d467276624 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:03.588930 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-6ff2ceb0-6e20-44d9-9cb6-75d467276624 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:03.769602 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-6ff2ceb0-6e20-44d9-9cb6-75d467276624 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:03.780089 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-6ff2ceb0-6e20-44d9-9cb6-75d467276624 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:03.782924 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-6ff2ceb0-6e20-44d9-9cb6-75d467276624 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:03.784183 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-6ff2ceb0-6e20-44d9-9cb6-75d467276624 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7" status: 200 len: 1745 microversion: 2.20 time: 0.236591 Oct 17 03:14:03.785253 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 191/361] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 03:14:03 2022] GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7 => generated 1745 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:14:04.089616 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-623a08b1-d9ae-4d7c-91ac-7e23853d43d2 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:14:04.090367 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-623a08b1-d9ae-4d7c-91ac-7e23853d43d2 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] [instance: 7b220b35-d9ac-48e4-b898-3d4f6c7be835] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:14:04.096612 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-623a08b1-d9ae-4d7c-91ac-7e23853d43d2 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:04.097195 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-623a08b1-d9ae-4d7c-91ac-7e23853d43d2 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:04.097659 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-623a08b1-d9ae-4d7c-91ac-7e23853d43d2 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:04.098357 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-623a08b1-d9ae-4d7c-91ac-7e23853d43d2 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:04.098817 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-623a08b1-d9ae-4d7c-91ac-7e23853d43d2 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:04.099372 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-623a08b1-d9ae-4d7c-91ac-7e23853d43d2 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:04.301903 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-ecfb2278-2c8e-4b1b-8fbc-528023b70a03 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:14:04.303174 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-ecfb2278-2c8e-4b1b-8fbc-528023b70a03 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: 90f2768b-8259-439c-af06-7eff342615ee] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:14:04.311245 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-ecfb2278-2c8e-4b1b-8fbc-528023b70a03 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:04.312038 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-ecfb2278-2c8e-4b1b-8fbc-528023b70a03 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:04.312669 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-ecfb2278-2c8e-4b1b-8fbc-528023b70a03 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:04.313404 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-ecfb2278-2c8e-4b1b-8fbc-528023b70a03 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:04.313862 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-ecfb2278-2c8e-4b1b-8fbc-528023b70a03 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:04.315008 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-ecfb2278-2c8e-4b1b-8fbc-528023b70a03 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:04.376235 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-623a08b1-d9ae-4d7c-91ac-7e23853d43d2 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce25db99a7b14d0bbaca41fff80e3da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5bad80dc0d74119b2a9cd5c1935e8d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:04.388239 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-623a08b1-d9ae-4d7c-91ac-7e23853d43d2 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] 10.222.0.27 "GET /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835" status: 200 len: 1725 microversion: 2.1 time: 0.302352 Oct 17 03:14:04.389124 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 171/362] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:14:04 2022] GET /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835 => generated 1725 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:14:04.511718 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-ecfb2278-2c8e-4b1b-8fbc-528023b70a03 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1787a9ef7c44e28076aaa80c0152fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee21a91b84794e80b208fe72b7f1e010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:04.520651 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-ecfb2278-2c8e-4b1b-8fbc-528023b70a03 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "GET /compute/v2.1/servers/90f2768b-8259-439c-af06-7eff342615ee" status: 200 len: 1510 microversion: 2.1 time: 0.224682 Oct 17 03:14:04.521760 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 192/363] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:14:04 2022] GET /compute/v2.1/servers/90f2768b-8259-439c-af06-7eff342615ee => generated 1510 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:14:04.816396 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-a6591c55-9da4-4af7-b190-1f755f505ff9 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:14:04.817931 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-a6591c55-9da4-4af7-b190-1f755f505ff9 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 603ee2bf-bedf-4688-ac0a-77a2a50f33d7] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:14:04.825372 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-a6591c55-9da4-4af7-b190-1f755f505ff9 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:04.825803 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-a6591c55-9da4-4af7-b190-1f755f505ff9 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:04.826477 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-a6591c55-9da4-4af7-b190-1f755f505ff9 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:04.827232 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-a6591c55-9da4-4af7-b190-1f755f505ff9 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:04.828062 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-a6591c55-9da4-4af7-b190-1f755f505ff9 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:04.828844 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-a6591c55-9da4-4af7-b190-1f755f505ff9 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:05.004562 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-a6591c55-9da4-4af7-b190-1f755f505ff9 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:05.014356 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-a6591c55-9da4-4af7-b190-1f755f505ff9 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:05.015764 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-a6591c55-9da4-4af7-b190-1f755f505ff9 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:05.017430 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-a6591c55-9da4-4af7-b190-1f755f505ff9 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7" status: 200 len: 1745 microversion: 2.20 time: 0.205267 Oct 17 03:14:05.017971 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 172/364] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 03:14:04 2022] GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7 => generated 1745 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:14:05.415839 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-cd6779b6-4754-4ae8-86a5-a86e4437660e tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:14:05.417717 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-cd6779b6-4754-4ae8-86a5-a86e4437660e tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] [instance: 7b220b35-d9ac-48e4-b898-3d4f6c7be835] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:14:05.436863 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-cd6779b6-4754-4ae8-86a5-a86e4437660e tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:05.437680 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-cd6779b6-4754-4ae8-86a5-a86e4437660e tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:05.439465 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-cd6779b6-4754-4ae8-86a5-a86e4437660e tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:05.443697 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-cd6779b6-4754-4ae8-86a5-a86e4437660e tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:05.444389 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-cd6779b6-4754-4ae8-86a5-a86e4437660e tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:05.445010 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-cd6779b6-4754-4ae8-86a5-a86e4437660e tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:05.545884 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-d3ffab3b-8010-4a87-b9ee-01dee174b365 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:14:05.547129 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-d3ffab3b-8010-4a87-b9ee-01dee174b365 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: 90f2768b-8259-439c-af06-7eff342615ee] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:14:05.557653 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-d3ffab3b-8010-4a87-b9ee-01dee174b365 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:05.560354 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-d3ffab3b-8010-4a87-b9ee-01dee174b365 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:05.561067 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-d3ffab3b-8010-4a87-b9ee-01dee174b365 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:05.563125 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-d3ffab3b-8010-4a87-b9ee-01dee174b365 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:05.565421 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-d3ffab3b-8010-4a87-b9ee-01dee174b365 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:05.566131 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-d3ffab3b-8010-4a87-b9ee-01dee174b365 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:05.661392 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-cd6779b6-4754-4ae8-86a5-a86e4437660e tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce25db99a7b14d0bbaca41fff80e3da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5bad80dc0d74119b2a9cd5c1935e8d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:05.676006 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-cd6779b6-4754-4ae8-86a5-a86e4437660e tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] 10.222.0.27 "GET /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835" status: 200 len: 1725 microversion: 2.1 time: 0.265102 Oct 17 03:14:05.677086 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 193/365] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:14:05 2022] GET /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835 => generated 1725 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:14:05.803265 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-d3ffab3b-8010-4a87-b9ee-01dee174b365 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1787a9ef7c44e28076aaa80c0152fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee21a91b84794e80b208fe72b7f1e010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:05.818179 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-d3ffab3b-8010-4a87-b9ee-01dee174b365 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "GET /compute/v2.1/servers/90f2768b-8259-439c-af06-7eff342615ee" status: 200 len: 1510 microversion: 2.1 time: 0.276445 Oct 17 03:14:05.830911 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 173/366] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:14:05 2022] GET /compute/v2.1/servers/90f2768b-8259-439c-af06-7eff342615ee => generated 1510 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:14:06.044294 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-874c9251-7d9c-4a3d-af74-90ddf7ce3c97 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:14:06.045049 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-874c9251-7d9c-4a3d-af74-90ddf7ce3c97 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 603ee2bf-bedf-4688-ac0a-77a2a50f33d7] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:14:06.051657 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-874c9251-7d9c-4a3d-af74-90ddf7ce3c97 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:06.052451 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-874c9251-7d9c-4a3d-af74-90ddf7ce3c97 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:06.053019 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-874c9251-7d9c-4a3d-af74-90ddf7ce3c97 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:06.053904 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-874c9251-7d9c-4a3d-af74-90ddf7ce3c97 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:06.054379 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-874c9251-7d9c-4a3d-af74-90ddf7ce3c97 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:06.055043 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-874c9251-7d9c-4a3d-af74-90ddf7ce3c97 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:06.227968 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-874c9251-7d9c-4a3d-af74-90ddf7ce3c97 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:06.231716 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG dbcounter [-] [118886] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:14:06.237930 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-874c9251-7d9c-4a3d-af74-90ddf7ce3c97 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:06.239412 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-874c9251-7d9c-4a3d-af74-90ddf7ce3c97 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:06.241294 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-874c9251-7d9c-4a3d-af74-90ddf7ce3c97 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7" status: 200 len: 1745 microversion: 2.20 time: 0.200922 Oct 17 03:14:06.242325 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 194/367] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 03:14:06 2022] GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7 => generated 1745 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:14:06.700894 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-c2667b1e-4695-43b4-a96d-2edff7110405 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:14:06.702231 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-c2667b1e-4695-43b4-a96d-2edff7110405 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] [instance: 7b220b35-d9ac-48e4-b898-3d4f6c7be835] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:14:06.709646 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-c2667b1e-4695-43b4-a96d-2edff7110405 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:06.710462 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-c2667b1e-4695-43b4-a96d-2edff7110405 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:06.711194 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-c2667b1e-4695-43b4-a96d-2edff7110405 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:06.712171 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-c2667b1e-4695-43b4-a96d-2edff7110405 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:06.712841 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-c2667b1e-4695-43b4-a96d-2edff7110405 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:06.713495 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-c2667b1e-4695-43b4-a96d-2edff7110405 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:06.852287 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-075c89b3-5183-4b2b-ad03-88be293de662 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:14:06.852851 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-075c89b3-5183-4b2b-ad03-88be293de662 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: 90f2768b-8259-439c-af06-7eff342615ee] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:14:06.867786 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-075c89b3-5183-4b2b-ad03-88be293de662 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:06.868327 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-075c89b3-5183-4b2b-ad03-88be293de662 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:06.868818 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-075c89b3-5183-4b2b-ad03-88be293de662 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:06.869610 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-075c89b3-5183-4b2b-ad03-88be293de662 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:06.870090 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-075c89b3-5183-4b2b-ad03-88be293de662 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:06.870544 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-075c89b3-5183-4b2b-ad03-88be293de662 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:06.935945 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-c2667b1e-4695-43b4-a96d-2edff7110405 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce25db99a7b14d0bbaca41fff80e3da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5bad80dc0d74119b2a9cd5c1935e8d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:06.945099 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-c2667b1e-4695-43b4-a96d-2edff7110405 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] 10.222.0.27 "GET /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835" status: 200 len: 1725 microversion: 2.1 time: 0.248317 Oct 17 03:14:06.945679 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 174/368] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:14:06 2022] GET /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835 => generated 1725 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:14:07.082171 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-075c89b3-5183-4b2b-ad03-88be293de662 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1787a9ef7c44e28076aaa80c0152fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee21a91b84794e80b208fe72b7f1e010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:07.090552 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-075c89b3-5183-4b2b-ad03-88be293de662 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "GET /compute/v2.1/servers/90f2768b-8259-439c-af06-7eff342615ee" status: 200 len: 1516 microversion: 2.1 time: 0.244588 Oct 17 03:14:07.091666 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 195/369] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:14:06 2022] GET /compute/v2.1/servers/90f2768b-8259-439c-af06-7eff342615ee => generated 1516 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:14:07.269150 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-09d88ed4-baa4-4fdb-a828-61cd0fa2340b tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:14:07.269998 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-09d88ed4-baa4-4fdb-a828-61cd0fa2340b tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 603ee2bf-bedf-4688-ac0a-77a2a50f33d7] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:14:07.290134 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-09d88ed4-baa4-4fdb-a828-61cd0fa2340b tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:07.290643 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-09d88ed4-baa4-4fdb-a828-61cd0fa2340b tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:07.291574 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-09d88ed4-baa4-4fdb-a828-61cd0fa2340b tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:07.292888 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-09d88ed4-baa4-4fdb-a828-61cd0fa2340b tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:07.293381 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-09d88ed4-baa4-4fdb-a828-61cd0fa2340b tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:07.294268 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-09d88ed4-baa4-4fdb-a828-61cd0fa2340b tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:07.473389 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-09d88ed4-baa4-4fdb-a828-61cd0fa2340b tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:07.484718 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-09d88ed4-baa4-4fdb-a828-61cd0fa2340b tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:07.486706 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-09d88ed4-baa4-4fdb-a828-61cd0fa2340b tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:07.488929 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-09d88ed4-baa4-4fdb-a828-61cd0fa2340b tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7" status: 200 len: 1740 microversion: 2.20 time: 0.224587 Oct 17 03:14:07.490407 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 175/370] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 03:14:07 2022] GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7 => generated 1740 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 03:14:07.976196 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-405a831e-3818-4d03-a24d-fbcf9efd4135 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:14:07.977926 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-405a831e-3818-4d03-a24d-fbcf9efd4135 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] [instance: 7b220b35-d9ac-48e4-b898-3d4f6c7be835] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:14:07.994118 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-405a831e-3818-4d03-a24d-fbcf9efd4135 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:07.995751 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-405a831e-3818-4d03-a24d-fbcf9efd4135 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:07.997923 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-405a831e-3818-4d03-a24d-fbcf9efd4135 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:07.999401 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-405a831e-3818-4d03-a24d-fbcf9efd4135 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:08.002474 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-405a831e-3818-4d03-a24d-fbcf9efd4135 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:08.003185 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-405a831e-3818-4d03-a24d-fbcf9efd4135 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:08.212895 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-405a831e-3818-4d03-a24d-fbcf9efd4135 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce25db99a7b14d0bbaca41fff80e3da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5bad80dc0d74119b2a9cd5c1935e8d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:08.233110 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-405a831e-3818-4d03-a24d-fbcf9efd4135 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] 10.222.0.27 "GET /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835" status: 200 len: 1725 microversion: 2.1 time: 0.263338 Oct 17 03:14:08.233709 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 196/371] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:14:07 2022] GET /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835 => generated 1725 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:14:08.503683 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [req-810c7f2c-38ab-4166-b75f-1f65a54c0110 req-973bcc2c-6c4a-4837-a8d4-7cec290197eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "603ee2bf-bedf-4688-ac0a-77a2a50f33d7", "name": "network-vif-plugged", "status": "completed", "tag": "faf2315a-88ad-4367-997b-65c1cf0209ee"}]} {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:14:08.522069 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-8daa11e3-e2e8-486b-b2bc-cd027b10abf3 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:14:08.522925 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-8daa11e3-e2e8-486b-b2bc-cd027b10abf3 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 603ee2bf-bedf-4688-ac0a-77a2a50f33d7] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:14:08.525121 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [req-810c7f2c-38ab-4166-b75f-1f65a54c0110 req-973bcc2c-6c4a-4837-a8d4-7cec290197eb service nova] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:08.529248 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [req-810c7f2c-38ab-4166-b75f-1f65a54c0110 req-973bcc2c-6c4a-4837-a8d4-7cec290197eb service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:08.530445 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [req-810c7f2c-38ab-4166-b75f-1f65a54c0110 req-973bcc2c-6c4a-4837-a8d4-7cec290197eb service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:08.533137 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-8daa11e3-e2e8-486b-b2bc-cd027b10abf3 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:08.533901 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-8daa11e3-e2e8-486b-b2bc-cd027b10abf3 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:08.534541 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-8daa11e3-e2e8-486b-b2bc-cd027b10abf3 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:08.535487 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-8daa11e3-e2e8-486b-b2bc-cd027b10abf3 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:08.536430 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-8daa11e3-e2e8-486b-b2bc-cd027b10abf3 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:08.537134 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-8daa11e3-e2e8-486b-b2bc-cd027b10abf3 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:08.583198 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.compute.server_external_events [req-810c7f2c-38ab-4166-b75f-1f65a54c0110 req-973bcc2c-6c4a-4837-a8d4-7cec290197eb service nova] Creating event network-vif-plugged:faf2315a-88ad-4367-997b-65c1cf0209ee for instance 603ee2bf-bedf-4688-ac0a-77a2a50f33d7 on hv-cinder-84697 Oct 17 03:14:08.597889 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [req-810c7f2c-38ab-4166-b75f-1f65a54c0110 req-973bcc2c-6c4a-4837-a8d4-7cec290197eb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099921 Oct 17 03:14:08.601409 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 176/372] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 03:14:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 03:14:08.649143 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-c6e18020-9c4f-4ebc-a8c3-a214883b3b64 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Action: 'create', calling method: .version_select at 0x7fc7018c5d30>, body: {"keypair": {"name": "tempest-keypair-611420744", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIHNAhiRU6jWmKqUzuWI9rk9Wf3I7CNTjyD4ZJYS7Y/bcDRlPNwJvqdNw3t5M8QMB6p/JwY79sbdjF0dW3j3ETZsACb6QR9yY5EovM2ECeonjhLSCNHXiGTWryP4hZ0a9w=="}} {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:14:08.675309 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.quota [None req-c6e18020-9c4f-4ebc-a8c3-a214883b3b64 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Getting quotas for project ee21a91b84794e80b208fe72b7f1e010. Resources: {'key_pairs'} {{(pid=118887) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 03:14:08.681732 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.quota [None req-c6e18020-9c4f-4ebc-a8c3-a214883b3b64 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Getting quotas for user 9c1787a9ef7c44e28076aaa80c0152fd and project ee21a91b84794e80b208fe72b7f1e010. Resources: {'key_pairs'} {{(pid=118887) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 03:14:08.713491 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-c6e18020-9c4f-4ebc-a8c3-a214883b3b64 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.068933 Oct 17 03:14:08.714570 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 177/373] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 17 03:14:08 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 03:14:08.877786 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-8daa11e3-e2e8-486b-b2bc-cd027b10abf3 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:08.888230 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-8daa11e3-e2e8-486b-b2bc-cd027b10abf3 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:08.895511 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-8daa11e3-e2e8-486b-b2bc-cd027b10abf3 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:08.897273 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-8daa11e3-e2e8-486b-b2bc-cd027b10abf3 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7" status: 200 len: 1740 microversion: 2.20 time: 0.380059 Oct 17 03:14:08.920393 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 197/374] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 03:14:08 2022] GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7 => generated 1740 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:14:09.262434 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-b76ec5f9-c38b-4c04-ab01-4b3ee18b1ccf tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:14:09.264413 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-b76ec5f9-c38b-4c04-ab01-4b3ee18b1ccf tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] [instance: 7b220b35-d9ac-48e4-b898-3d4f6c7be835] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:14:09.282335 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-b76ec5f9-c38b-4c04-ab01-4b3ee18b1ccf tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:09.291721 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-b76ec5f9-c38b-4c04-ab01-4b3ee18b1ccf tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:09.298550 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-b76ec5f9-c38b-4c04-ab01-4b3ee18b1ccf tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:09.309423 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-b76ec5f9-c38b-4c04-ab01-4b3ee18b1ccf tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:09.311046 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-b76ec5f9-c38b-4c04-ab01-4b3ee18b1ccf tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:09.312609 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-b76ec5f9-c38b-4c04-ab01-4b3ee18b1ccf tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:09.437957 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-c7ca90b6-daaf-4c1b-8dc3-1d795f5702c3 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Action: 'create', calling method: .version_select at 0x7fc7018d20d0>, body: {"keypair": {"name": "tempest-keypair-2077377061", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFi/kdFItVffU1h2MsWvxUpXpBUBmaFVydIPlc5TbT7HYsqwgNLjbRIGCCXag7u/PGLoP/eP2ePoHLGJC3exDxqROEJD/R8BFwOvtwg4fMFNBKjm4skM7X34j6aFHs68tQ=="}} {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:14:09.486022 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.quota [None req-c7ca90b6-daaf-4c1b-8dc3-1d795f5702c3 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Getting quotas for project 618cf0b3507845909bb27c13460d1d6c. Resources: {'key_pairs'} {{(pid=118886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 03:14:09.500155 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.quota [None req-c7ca90b6-daaf-4c1b-8dc3-1d795f5702c3 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Getting quotas for user 1c786544e8fb4e8e8c3a4990a0f36725 and project 618cf0b3507845909bb27c13460d1d6c. Resources: {'key_pairs'} {{(pid=118886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 03:14:09.566324 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-c7ca90b6-daaf-4c1b-8dc3-1d795f5702c3 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.132104 Oct 17 03:14:09.567427 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 198/375] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 17 03:14:09 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:14:09.724559 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-b76ec5f9-c38b-4c04-ab01-4b3ee18b1ccf tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce25db99a7b14d0bbaca41fff80e3da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5bad80dc0d74119b2a9cd5c1935e8d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:09.729330 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG dbcounter [-] [118887] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:14:09.746417 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-b76ec5f9-c38b-4c04-ab01-4b3ee18b1ccf tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] 10.222.0.27 "GET /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835" status: 200 len: 1725 microversion: 2.1 time: 0.488841 Oct 17 03:14:09.761212 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 178/376] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:14:09 2022] GET /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835 => generated 1725 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:14:09.934699 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-0e9855f9-eead-4a7e-8c65-d087193677b9 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:14:09.935473 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-0e9855f9-eead-4a7e-8c65-d087193677b9 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 603ee2bf-bedf-4688-ac0a-77a2a50f33d7] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:14:09.978217 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-0e9855f9-eead-4a7e-8c65-d087193677b9 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:09.979111 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-0e9855f9-eead-4a7e-8c65-d087193677b9 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:09.979579 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-0e9855f9-eead-4a7e-8c65-d087193677b9 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:09.980331 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-0e9855f9-eead-4a7e-8c65-d087193677b9 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:09.980786 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-0e9855f9-eead-4a7e-8c65-d087193677b9 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:09.986683 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-0e9855f9-eead-4a7e-8c65-d087193677b9 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:10.422382 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-0e9855f9-eead-4a7e-8c65-d087193677b9 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:10.448909 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-0e9855f9-eead-4a7e-8c65-d087193677b9 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:10.456935 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-0e9855f9-eead-4a7e-8c65-d087193677b9 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:10.461760 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-0e9855f9-eead-4a7e-8c65-d087193677b9 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7" status: 200 len: 1740 microversion: 2.20 time: 0.530500 Oct 17 03:14:10.462530 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 199/377] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 03:14:09 2022] GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7 => generated 1740 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:14:10.780926 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-4f201a64-c85c-45f4-a4d4-33598dfaa8af tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:14:10.782403 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-4f201a64-c85c-45f4-a4d4-33598dfaa8af tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] [instance: 7b220b35-d9ac-48e4-b898-3d4f6c7be835] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:14:10.797337 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-4f201a64-c85c-45f4-a4d4-33598dfaa8af tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:10.805844 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-4f201a64-c85c-45f4-a4d4-33598dfaa8af tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:10.806630 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-4f201a64-c85c-45f4-a4d4-33598dfaa8af tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:10.807630 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-4f201a64-c85c-45f4-a4d4-33598dfaa8af tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:10.811526 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-4f201a64-c85c-45f4-a4d4-33598dfaa8af tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:10.812023 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-4f201a64-c85c-45f4-a4d4-33598dfaa8af tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:11.331577 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-4f201a64-c85c-45f4-a4d4-33598dfaa8af tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce25db99a7b14d0bbaca41fff80e3da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5bad80dc0d74119b2a9cd5c1935e8d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:11.362945 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-4f201a64-c85c-45f4-a4d4-33598dfaa8af tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] 10.222.0.27 "GET /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835" status: 200 len: 1725 microversion: 2.1 time: 0.587294 Oct 17 03:14:11.369547 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 179/378] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:14:10 2022] GET /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835 => generated 1725 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:14:11.493231 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-25d34feb-c0b4-43b3-97e5-068040ed700c tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:14:11.494747 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-25d34feb-c0b4-43b3-97e5-068040ed700c tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 603ee2bf-bedf-4688-ac0a-77a2a50f33d7] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:14:11.508569 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-25d34feb-c0b4-43b3-97e5-068040ed700c tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:11.512905 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-25d34feb-c0b4-43b3-97e5-068040ed700c tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:11.513580 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-25d34feb-c0b4-43b3-97e5-068040ed700c tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:11.517459 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-25d34feb-c0b4-43b3-97e5-068040ed700c tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:11.519918 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-25d34feb-c0b4-43b3-97e5-068040ed700c tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:11.521633 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-25d34feb-c0b4-43b3-97e5-068040ed700c tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:11.975555 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-25d34feb-c0b4-43b3-97e5-068040ed700c tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:11.984675 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-25d34feb-c0b4-43b3-97e5-068040ed700c tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:11.986126 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-25d34feb-c0b4-43b3-97e5-068040ed700c tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:11.987332 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-25d34feb-c0b4-43b3-97e5-068040ed700c tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7" status: 200 len: 1740 microversion: 2.20 time: 0.501665 Oct 17 03:14:11.987888 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 200/379] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 03:14:11 2022] GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7 => generated 1740 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:14:12.127098 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-9a04458e-cdd5-40d0-96c1-df6b113fbb1a tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-362483020", "imageRef": "e6d41914-f1bc-4b72-9113-1a69b3d0d83b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9271d0b1-69d9-42d2-822e-fbd76c069e42"}], "security_groups": [{"name": "tempest-securitygroup--788181374"}], "key_name": "tempest-keypair-611420744", "user_data": "}} {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:14:12.392194 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-6bd65f56-7ae3-4178-a488-cc797fddd550 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:14:12.393196 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-6bd65f56-7ae3-4178-a488-cc797fddd550 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] [instance: 7b220b35-d9ac-48e4-b898-3d4f6c7be835] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:14:12.406555 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-6bd65f56-7ae3-4178-a488-cc797fddd550 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:12.407428 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-6bd65f56-7ae3-4178-a488-cc797fddd550 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:12.408094 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-6bd65f56-7ae3-4178-a488-cc797fddd550 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:12.409006 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-6bd65f56-7ae3-4178-a488-cc797fddd550 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:12.409624 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-6bd65f56-7ae3-4178-a488-cc797fddd550 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:12.410052 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-6bd65f56-7ae3-4178-a488-cc797fddd550 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:12.717653 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-6bd65f56-7ae3-4178-a488-cc797fddd550 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce25db99a7b14d0bbaca41fff80e3da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5bad80dc0d74119b2a9cd5c1935e8d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:12.731492 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-6bd65f56-7ae3-4178-a488-cc797fddd550 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] 10.222.0.27 "GET /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835" status: 200 len: 1725 microversion: 2.1 time: 0.343030 Oct 17 03:14:12.732677 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 201/380] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:14:12 2022] GET /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835 => generated 1725 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:14:12.827964 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-11d64045-24a0-451e-a1b9-83e4aee81f48 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2042193338", "imageRef": "e6d41914-f1bc-4b72-9113-1a69b3d0d83b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5bef7eaf-4926-430d-bb2f-ad10a16554bf"}], "security_groups": [{"name": "tempest-securitygroup--1540481868"}], "key_name": "tempest-keypair-2077377061", "user_data": "}} {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:14:16.365452 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.network.neutron [None req-9a04458e-cdd5-40d0-96c1-df6b113fbb1a tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] validate_networks() for [('9271d0b1-69d9-42d2-822e-fbd76c069e42', None, None, None, None, None)] {{(pid=118887) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 03:14:16.370985 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.network.neutron [None req-11d64045-24a0-451e-a1b9-83e4aee81f48 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] validate_networks() for [('5bef7eaf-4926-430d-bb2f-ad10a16554bf', None, None, None, None, None)] {{(pid=118886) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 03:14:16.602163 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG dbcounter [-] [118886] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=118886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:14:16.606491 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG dbcounter [-] [118887] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=1 {{(pid=118887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:14:16.846249 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.virt.hardware [None req-11d64045-24a0-451e-a1b9-83e4aee81f48 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Flavor limits 0:0:0 {{(pid=118886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 03:14:16.847090 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.virt.hardware [None req-11d64045-24a0-451e-a1b9-83e4aee81f48 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Image limits 0:0:0 {{(pid=118886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 03:14:16.847912 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.virt.hardware [None req-11d64045-24a0-451e-a1b9-83e4aee81f48 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Flavor pref 0:0:0 {{(pid=118886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 03:14:16.848527 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.virt.hardware [None req-11d64045-24a0-451e-a1b9-83e4aee81f48 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Image pref 0:0:0 {{(pid=118886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 03:14:16.849179 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.virt.hardware [None req-11d64045-24a0-451e-a1b9-83e4aee81f48 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 03:14:16.855757 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.virt.hardware [None req-9a04458e-cdd5-40d0-96c1-df6b113fbb1a tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Flavor limits 0:0:0 {{(pid=118887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 03:14:16.856180 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.virt.hardware [None req-9a04458e-cdd5-40d0-96c1-df6b113fbb1a tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Image limits 0:0:0 {{(pid=118887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 03:14:16.856650 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.virt.hardware [None req-9a04458e-cdd5-40d0-96c1-df6b113fbb1a tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Flavor pref 0:0:0 {{(pid=118887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 03:14:16.857058 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.virt.hardware [None req-9a04458e-cdd5-40d0-96c1-df6b113fbb1a tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Image pref 0:0:0 {{(pid=118887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 03:14:16.857484 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.virt.hardware [None req-9a04458e-cdd5-40d0-96c1-df6b113fbb1a tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 03:14:16.862749 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-11d64045-24a0-451e-a1b9-83e4aee81f48 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:16.863509 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-11d64045-24a0-451e-a1b9-83e4aee81f48 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:16.864173 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-11d64045-24a0-451e-a1b9-83e4aee81f48 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:16.866170 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-11d64045-24a0-451e-a1b9-83e4aee81f48 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:16.867808 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-11d64045-24a0-451e-a1b9-83e4aee81f48 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:16.868020 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-9a04458e-cdd5-40d0-96c1-df6b113fbb1a tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:16.868515 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-9a04458e-cdd5-40d0-96c1-df6b113fbb1a tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:16.868866 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-11d64045-24a0-451e-a1b9-83e4aee81f48 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:16.868993 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-9a04458e-cdd5-40d0-96c1-df6b113fbb1a tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:16.869815 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-9a04458e-cdd5-40d0-96c1-df6b113fbb1a tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:16.870296 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-9a04458e-cdd5-40d0-96c1-df6b113fbb1a tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:16.870736 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-9a04458e-cdd5-40d0-96c1-df6b113fbb1a tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:16.890766 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.quota [None req-11d64045-24a0-451e-a1b9-83e4aee81f48 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Getting quotas for project 618cf0b3507845909bb27c13460d1d6c. Resources: {'instances', 'cores', 'ram'} {{(pid=118886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 03:14:16.893050 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.quota [None req-9a04458e-cdd5-40d0-96c1-df6b113fbb1a tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Getting quotas for project ee21a91b84794e80b208fe72b7f1e010. Resources: {'instances', 'cores', 'ram'} {{(pid=118887) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 03:14:16.896505 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.quota [None req-11d64045-24a0-451e-a1b9-83e4aee81f48 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Getting quotas for user 1c786544e8fb4e8e8c3a4990a0f36725 and project 618cf0b3507845909bb27c13460d1d6c. Resources: {'instances', 'cores', 'ram'} {{(pid=118886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 03:14:16.897341 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.quota [None req-9a04458e-cdd5-40d0-96c1-df6b113fbb1a tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Getting quotas for user 9c1787a9ef7c44e28076aaa80c0152fd and project ee21a91b84794e80b208fe72b7f1e010. Resources: {'instances', 'cores', 'ram'} {{(pid=118887) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 03:14:16.909503 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-9a04458e-cdd5-40d0-96c1-df6b113fbb1a tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Going to run 1 instances... {{(pid=118887) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 03:14:16.910039 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-11d64045-24a0-451e-a1b9-83e4aee81f48 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Going to run 1 instances... {{(pid=118886) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 03:14:16.912042 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-9a04458e-cdd5-40d0-96c1-df6b113fbb1a tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: 712578d1-d2fb-4252-adbb-bc87096acc00] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e6d41914-f1bc-4b72-9113-1a69b3d0d83b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118887) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 03:14:16.912986 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-11d64045-24a0-451e-a1b9-83e4aee81f48 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] [instance: d834c830-cb7f-43ce-ac79-2bf168e8f664] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e6d41914-f1bc-4b72-9113-1a69b3d0d83b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 03:14:16.969776 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-9a04458e-cdd5-40d0-96c1-df6b113fbb1a tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 4.848958 Oct 17 03:14:16.970842 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 180/381] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 03:14:12 2022] POST /compute/v2.1/servers => generated 408 bytes in 4851 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 03:14:16.981641 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-4251eb91-a2e6-415b-8811-0fd4b810d2d5 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:14:16.982590 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-4251eb91-a2e6-415b-8811-0fd4b810d2d5 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 603ee2bf-bedf-4688-ac0a-77a2a50f33d7] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:14:16.990609 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-4251eb91-a2e6-415b-8811-0fd4b810d2d5 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:16.991606 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-4251eb91-a2e6-415b-8811-0fd4b810d2d5 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:16.992281 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-4251eb91-a2e6-415b-8811-0fd4b810d2d5 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:16.993296 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-4251eb91-a2e6-415b-8811-0fd4b810d2d5 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:16.994265 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-4251eb91-a2e6-415b-8811-0fd4b810d2d5 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:16.995087 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-4251eb91-a2e6-415b-8811-0fd4b810d2d5 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:16.996342 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-11d64045-24a0-451e-a1b9-83e4aee81f48 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 4.173532 Oct 17 03:14:16.997293 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 202/382] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 03:14:12 2022] POST /compute/v2.1/servers => generated 402 bytes in 4175 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 17 03:14:17.004744 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-8e4b859b-1ed6-4158-a325-7be31fb16e80 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:14:17.005720 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-8e4b859b-1ed6-4158-a325-7be31fb16e80 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] [instance: 7b220b35-d9ac-48e4-b898-3d4f6c7be835] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:14:17.012868 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-8e4b859b-1ed6-4158-a325-7be31fb16e80 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:17.013350 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-8e4b859b-1ed6-4158-a325-7be31fb16e80 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:17.013826 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-8e4b859b-1ed6-4158-a325-7be31fb16e80 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:17.014521 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-8e4b859b-1ed6-4158-a325-7be31fb16e80 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:17.015008 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-8e4b859b-1ed6-4158-a325-7be31fb16e80 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:17.015704 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-8e4b859b-1ed6-4158-a325-7be31fb16e80 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:17.280853 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-4251eb91-a2e6-415b-8811-0fd4b810d2d5 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:17.293123 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-4251eb91-a2e6-415b-8811-0fd4b810d2d5 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:17.295197 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-4251eb91-a2e6-415b-8811-0fd4b810d2d5 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:17.297628 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-8e4b859b-1ed6-4158-a325-7be31fb16e80 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce25db99a7b14d0bbaca41fff80e3da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5bad80dc0d74119b2a9cd5c1935e8d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:17.299831 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-4251eb91-a2e6-415b-8811-0fd4b810d2d5 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7" status: 200 len: 1740 microversion: 2.20 time: 0.327569 Oct 17 03:14:17.303314 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 181/383] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 03:14:16 2022] GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7 => generated 1740 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:14:17.309346 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-8e4b859b-1ed6-4158-a325-7be31fb16e80 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] 10.222.0.27 "GET /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835" status: 200 len: 1725 microversion: 2.1 time: 0.311018 Oct 17 03:14:17.319131 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 203/384] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:14:16 2022] GET /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835 => generated 1725 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:14:17.319131 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-6577912c-6863-484d-b77b-586d9911cf77 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:14:17.319131 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-6577912c-6863-484d-b77b-586d9911cf77 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] [instance: d834c830-cb7f-43ce-ac79-2bf168e8f664] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:14:17.329472 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-93f5bd25-fa37-41f2-93d3-a53df5c306d9 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:14:17.330251 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-93f5bd25-fa37-41f2-93d3-a53df5c306d9 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: 712578d1-d2fb-4252-adbb-bc87096acc00] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:14:17.409216 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-93f5bd25-fa37-41f2-93d3-a53df5c306d9 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1787a9ef7c44e28076aaa80c0152fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee21a91b84794e80b208fe72b7f1e010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:17.418787 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-93f5bd25-fa37-41f2-93d3-a53df5c306d9 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "GET /compute/v2.1/servers/712578d1-d2fb-4252-adbb-bc87096acc00" status: 200 len: 1244 microversion: 2.1 time: 0.112051 Oct 17 03:14:17.420047 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 182/385] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:14:17 2022] GET /compute/v2.1/servers/712578d1-d2fb-4252-adbb-bc87096acc00 => generated 1244 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:14:17.431504 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-6577912c-6863-484d-b77b-586d9911cf77 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c786544e8fb4e8e8c3a4990a0f36725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618cf0b3507845909bb27c13460d1d6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:17.439055 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-6577912c-6863-484d-b77b-586d9911cf77 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] 10.222.0.27 "GET /compute/v2.1/servers/d834c830-cb7f-43ce-ac79-2bf168e8f664" status: 200 len: 1242 microversion: 2.1 time: 0.127980 Oct 17 03:14:17.439616 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 204/386] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:14:17 2022] GET /compute/v2.1/servers/d834c830-cb7f-43ce-ac79-2bf168e8f664 => generated 1242 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:14:18.331875 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-4674be98-dd0a-4c36-a83d-a6315849878c tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:14:18.332829 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-4674be98-dd0a-4c36-a83d-a6315849878c tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 603ee2bf-bedf-4688-ac0a-77a2a50f33d7] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:14:18.335502 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-0ac8bc16-4366-4c44-8dd7-877171e9848b tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:14:18.336351 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-0ac8bc16-4366-4c44-8dd7-877171e9848b tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] [instance: 7b220b35-d9ac-48e4-b898-3d4f6c7be835] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:14:18.341439 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-4674be98-dd0a-4c36-a83d-a6315849878c tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:18.342182 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-4674be98-dd0a-4c36-a83d-a6315849878c tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:18.342703 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-4674be98-dd0a-4c36-a83d-a6315849878c tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:18.343664 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-4674be98-dd0a-4c36-a83d-a6315849878c tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:18.344528 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-4674be98-dd0a-4c36-a83d-a6315849878c tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:18.344730 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-0ac8bc16-4366-4c44-8dd7-877171e9848b tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:18.345358 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-0ac8bc16-4366-4c44-8dd7-877171e9848b tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:18.345633 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-4674be98-dd0a-4c36-a83d-a6315849878c tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:18.345955 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-0ac8bc16-4366-4c44-8dd7-877171e9848b tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:18.346658 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-0ac8bc16-4366-4c44-8dd7-877171e9848b tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:18.347131 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-0ac8bc16-4366-4c44-8dd7-877171e9848b tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:18.347727 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-0ac8bc16-4366-4c44-8dd7-877171e9848b tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:18.529958 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-0ac8bc16-4366-4c44-8dd7-877171e9848b tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce25db99a7b14d0bbaca41fff80e3da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5bad80dc0d74119b2a9cd5c1935e8d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:18.531337 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-4674be98-dd0a-4c36-a83d-a6315849878c tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:18.540516 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-4674be98-dd0a-4c36-a83d-a6315849878c tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:18.540662 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-0ac8bc16-4366-4c44-8dd7-877171e9848b tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] 10.222.0.27 "GET /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835" status: 200 len: 1725 microversion: 2.1 time: 0.209846 Oct 17 03:14:18.542084 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-4674be98-dd0a-4c36-a83d-a6315849878c tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:18.543733 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-4674be98-dd0a-4c36-a83d-a6315849878c tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7" status: 200 len: 1740 microversion: 2.20 time: 0.216267 Oct 17 03:14:18.544721 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 183/387] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 03:14:18 2022] GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7 => generated 1740 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 03:14:18.549110 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-f2744d76-818f-4ddb-8797-b7abdb953744 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:14:18.549963 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-f2744d76-818f-4ddb-8797-b7abdb953744 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: 712578d1-d2fb-4252-adbb-bc87096acc00] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:14:18.557556 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 205/388] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:14:18 2022] GET /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835 => generated 1725 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:14:18.563414 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-ebd64979-92fb-4bdc-963c-2e92193caf5b tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:14:18.564128 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-ebd64979-92fb-4bdc-963c-2e92193caf5b tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] [instance: d834c830-cb7f-43ce-ac79-2bf168e8f664] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:14:18.568223 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-f2744d76-818f-4ddb-8797-b7abdb953744 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:18.568936 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-f2744d76-818f-4ddb-8797-b7abdb953744 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:18.569536 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-f2744d76-818f-4ddb-8797-b7abdb953744 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:18.570411 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-f2744d76-818f-4ddb-8797-b7abdb953744 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:18.571063 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-f2744d76-818f-4ddb-8797-b7abdb953744 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:18.571687 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-f2744d76-818f-4ddb-8797-b7abdb953744 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:18.571975 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-ebd64979-92fb-4bdc-963c-2e92193caf5b tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:18.572531 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-ebd64979-92fb-4bdc-963c-2e92193caf5b tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:18.573038 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-ebd64979-92fb-4bdc-963c-2e92193caf5b tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:18.573801 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-ebd64979-92fb-4bdc-963c-2e92193caf5b tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:18.574326 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-ebd64979-92fb-4bdc-963c-2e92193caf5b tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:18.574833 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-ebd64979-92fb-4bdc-963c-2e92193caf5b tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:18.648617 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-ebd64979-92fb-4bdc-963c-2e92193caf5b tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c786544e8fb4e8e8c3a4990a0f36725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618cf0b3507845909bb27c13460d1d6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:18.650933 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-f2744d76-818f-4ddb-8797-b7abdb953744 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1787a9ef7c44e28076aaa80c0152fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee21a91b84794e80b208fe72b7f1e010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:18.657486 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-ebd64979-92fb-4bdc-963c-2e92193caf5b tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] 10.222.0.27 "GET /compute/v2.1/servers/d834c830-cb7f-43ce-ac79-2bf168e8f664" status: 200 len: 1246 microversion: 2.1 time: 0.098212 Oct 17 03:14:18.658184 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 206/389] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:14:18 2022] GET /compute/v2.1/servers/d834c830-cb7f-43ce-ac79-2bf168e8f664 => generated 1246 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:14:18.659460 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-f2744d76-818f-4ddb-8797-b7abdb953744 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "GET /compute/v2.1/servers/712578d1-d2fb-4252-adbb-bc87096acc00" status: 200 len: 1248 microversion: 2.1 time: 0.113688 Oct 17 03:14:18.660236 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 184/390] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:14:18 2022] GET /compute/v2.1/servers/712578d1-d2fb-4252-adbb-bc87096acc00 => generated 1248 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:14:19.564697 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-9b0cb16b-f09b-495c-9605-92a267fd4ab8 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:14:19.565290 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-9b0cb16b-f09b-495c-9605-92a267fd4ab8 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] [instance: 7b220b35-d9ac-48e4-b898-3d4f6c7be835] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:14:19.572654 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-9b0cb16b-f09b-495c-9605-92a267fd4ab8 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:19.573427 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-9b0cb16b-f09b-495c-9605-92a267fd4ab8 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:19.574364 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-9b0cb16b-f09b-495c-9605-92a267fd4ab8 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:19.575017 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-247378c3-4f86-44b7-9587-6add6c2e9a04 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:14:19.575594 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-9b0cb16b-f09b-495c-9605-92a267fd4ab8 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:19.575832 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-9b0cb16b-f09b-495c-9605-92a267fd4ab8 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:19.576433 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-9b0cb16b-f09b-495c-9605-92a267fd4ab8 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:19.577047 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-247378c3-4f86-44b7-9587-6add6c2e9a04 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 603ee2bf-bedf-4688-ac0a-77a2a50f33d7] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:14:19.585712 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-247378c3-4f86-44b7-9587-6add6c2e9a04 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:19.587242 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-247378c3-4f86-44b7-9587-6add6c2e9a04 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:19.587946 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-247378c3-4f86-44b7-9587-6add6c2e9a04 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:19.588957 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-247378c3-4f86-44b7-9587-6add6c2e9a04 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:19.589629 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-247378c3-4f86-44b7-9587-6add6c2e9a04 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:19.590454 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-247378c3-4f86-44b7-9587-6add6c2e9a04 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:19.762061 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-9b0cb16b-f09b-495c-9605-92a267fd4ab8 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce25db99a7b14d0bbaca41fff80e3da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5bad80dc0d74119b2a9cd5c1935e8d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:19.774049 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-9b0cb16b-f09b-495c-9605-92a267fd4ab8 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] 10.222.0.27 "GET /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835" status: 200 len: 1725 microversion: 2.1 time: 0.213397 Oct 17 03:14:19.774899 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 207/391] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:14:19 2022] GET /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835 => generated 1725 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:14:19.781483 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-7a6ac25f-3298-4cd1-8d52-afd5c406a204 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:14:19.782262 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-7a6ac25f-3298-4cd1-8d52-afd5c406a204 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: 712578d1-d2fb-4252-adbb-bc87096acc00] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:14:19.790261 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-7a6ac25f-3298-4cd1-8d52-afd5c406a204 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:19.790762 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-7a6ac25f-3298-4cd1-8d52-afd5c406a204 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:19.791234 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-7a6ac25f-3298-4cd1-8d52-afd5c406a204 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:19.792137 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-7a6ac25f-3298-4cd1-8d52-afd5c406a204 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:19.792624 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-7a6ac25f-3298-4cd1-8d52-afd5c406a204 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:19.793078 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-7a6ac25f-3298-4cd1-8d52-afd5c406a204 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:19.820768 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-247378c3-4f86-44b7-9587-6add6c2e9a04 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:19.830568 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-247378c3-4f86-44b7-9587-6add6c2e9a04 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:19.834504 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-247378c3-4f86-44b7-9587-6add6c2e9a04 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:19.836179 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-247378c3-4f86-44b7-9587-6add6c2e9a04 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7" status: 200 len: 1740 microversion: 2.20 time: 0.265311 Oct 17 03:14:19.837477 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 185/392] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 03:14:19 2022] GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7 => generated 1740 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:14:19.842550 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-f19645bc-5876-4848-8efb-c115607cbce0 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:14:19.843476 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-f19645bc-5876-4848-8efb-c115607cbce0 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] [instance: d834c830-cb7f-43ce-ac79-2bf168e8f664] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:14:19.850552 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-f19645bc-5876-4848-8efb-c115607cbce0 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:19.851365 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-f19645bc-5876-4848-8efb-c115607cbce0 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:19.852393 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-f19645bc-5876-4848-8efb-c115607cbce0 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:19.853406 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-f19645bc-5876-4848-8efb-c115607cbce0 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:19.853936 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-f19645bc-5876-4848-8efb-c115607cbce0 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:19.854447 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-f19645bc-5876-4848-8efb-c115607cbce0 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:19.872506 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-7a6ac25f-3298-4cd1-8d52-afd5c406a204 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1787a9ef7c44e28076aaa80c0152fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee21a91b84794e80b208fe72b7f1e010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:19.881465 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-7a6ac25f-3298-4cd1-8d52-afd5c406a204 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "GET /compute/v2.1/servers/712578d1-d2fb-4252-adbb-bc87096acc00" status: 200 len: 1296 microversion: 2.1 time: 0.105507 Oct 17 03:14:19.882044 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 208/393] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:14:19 2022] GET /compute/v2.1/servers/712578d1-d2fb-4252-adbb-bc87096acc00 => generated 1296 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:14:19.920848 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-f19645bc-5876-4848-8efb-c115607cbce0 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c786544e8fb4e8e8c3a4990a0f36725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618cf0b3507845909bb27c13460d1d6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:19.929331 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-f19645bc-5876-4848-8efb-c115607cbce0 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] 10.222.0.27 "GET /compute/v2.1/servers/d834c830-cb7f-43ce-ac79-2bf168e8f664" status: 200 len: 1238 microversion: 2.1 time: 0.090635 Oct 17 03:14:19.929885 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 186/394] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:14:19 2022] GET /compute/v2.1/servers/d834c830-cb7f-43ce-ac79-2bf168e8f664 => generated 1238 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:14:20.801514 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-96b8ab93-bf32-41f0-9a2c-6c7309d7a350 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:14:20.802196 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-96b8ab93-bf32-41f0-9a2c-6c7309d7a350 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] [instance: 7b220b35-d9ac-48e4-b898-3d4f6c7be835] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:14:20.809757 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-96b8ab93-bf32-41f0-9a2c-6c7309d7a350 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:20.810293 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-96b8ab93-bf32-41f0-9a2c-6c7309d7a350 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:20.810829 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-96b8ab93-bf32-41f0-9a2c-6c7309d7a350 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:20.811558 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-96b8ab93-bf32-41f0-9a2c-6c7309d7a350 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:20.812005 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-96b8ab93-bf32-41f0-9a2c-6c7309d7a350 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:20.812425 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-96b8ab93-bf32-41f0-9a2c-6c7309d7a350 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:20.863727 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-43e203bd-2e65-40e4-8fd4-eab64c649477 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:14:20.864332 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-43e203bd-2e65-40e4-8fd4-eab64c649477 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 603ee2bf-bedf-4688-ac0a-77a2a50f33d7] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:14:20.871876 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-43e203bd-2e65-40e4-8fd4-eab64c649477 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:20.872837 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-43e203bd-2e65-40e4-8fd4-eab64c649477 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:20.873367 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-43e203bd-2e65-40e4-8fd4-eab64c649477 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:20.874451 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-43e203bd-2e65-40e4-8fd4-eab64c649477 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:20.875038 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-43e203bd-2e65-40e4-8fd4-eab64c649477 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:20.875690 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-43e203bd-2e65-40e4-8fd4-eab64c649477 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:20.957841 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-96b8ab93-bf32-41f0-9a2c-6c7309d7a350 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce25db99a7b14d0bbaca41fff80e3da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5bad80dc0d74119b2a9cd5c1935e8d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:20.969639 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-96b8ab93-bf32-41f0-9a2c-6c7309d7a350 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] 10.222.0.27 "GET /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835" status: 200 len: 1725 microversion: 2.1 time: 0.171753 Oct 17 03:14:20.970832 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 209/395] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:14:20 2022] GET /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835 => generated 1725 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:14:20.976281 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-72784a7e-50e1-40d3-b0cd-7914893309ab tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:14:20.977063 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-72784a7e-50e1-40d3-b0cd-7914893309ab tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: 712578d1-d2fb-4252-adbb-bc87096acc00] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:14:20.983325 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-72784a7e-50e1-40d3-b0cd-7914893309ab tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:20.983879 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-72784a7e-50e1-40d3-b0cd-7914893309ab tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:20.984364 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-72784a7e-50e1-40d3-b0cd-7914893309ab tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:20.985229 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-72784a7e-50e1-40d3-b0cd-7914893309ab tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:20.985791 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-72784a7e-50e1-40d3-b0cd-7914893309ab tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:20.986309 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-72784a7e-50e1-40d3-b0cd-7914893309ab tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:21.053086 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-43e203bd-2e65-40e4-8fd4-eab64c649477 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:21.062997 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-43e203bd-2e65-40e4-8fd4-eab64c649477 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:21.064566 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-72784a7e-50e1-40d3-b0cd-7914893309ab tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1787a9ef7c44e28076aaa80c0152fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee21a91b84794e80b208fe72b7f1e010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:21.064954 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-43e203bd-2e65-40e4-8fd4-eab64c649477 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:21.066407 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-43e203bd-2e65-40e4-8fd4-eab64c649477 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7" status: 200 len: 1740 microversion: 2.20 time: 0.207513 Oct 17 03:14:21.067512 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 187/396] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 03:14:20 2022] GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7 => generated 1740 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 03:14:21.072692 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-10a88c76-2042-4051-bfe6-db2acb1f47e8 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:14:21.073536 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-10a88c76-2042-4051-bfe6-db2acb1f47e8 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] [instance: d834c830-cb7f-43ce-ac79-2bf168e8f664] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:14:21.075989 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-72784a7e-50e1-40d3-b0cd-7914893309ab tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "GET /compute/v2.1/servers/712578d1-d2fb-4252-adbb-bc87096acc00" status: 200 len: 1304 microversion: 2.1 time: 0.103854 Oct 17 03:14:21.076565 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 210/397] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:14:20 2022] GET /compute/v2.1/servers/712578d1-d2fb-4252-adbb-bc87096acc00 => generated 1304 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:14:21.090927 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-10a88c76-2042-4051-bfe6-db2acb1f47e8 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:21.090927 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-10a88c76-2042-4051-bfe6-db2acb1f47e8 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:21.090927 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-10a88c76-2042-4051-bfe6-db2acb1f47e8 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:21.090927 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-10a88c76-2042-4051-bfe6-db2acb1f47e8 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:21.091386 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-10a88c76-2042-4051-bfe6-db2acb1f47e8 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:21.091386 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-10a88c76-2042-4051-bfe6-db2acb1f47e8 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:21.376280 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-10a88c76-2042-4051-bfe6-db2acb1f47e8 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c786544e8fb4e8e8c3a4990a0f36725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618cf0b3507845909bb27c13460d1d6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:21.385406 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-10a88c76-2042-4051-bfe6-db2acb1f47e8 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] 10.222.0.27 "GET /compute/v2.1/servers/d834c830-cb7f-43ce-ac79-2bf168e8f664" status: 200 len: 1294 microversion: 2.1 time: 0.316548 Oct 17 03:14:21.386132 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 188/398] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:14:21 2022] GET /compute/v2.1/servers/d834c830-cb7f-43ce-ac79-2bf168e8f664 => generated 1294 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:14:21.996551 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-7fc9ea3a-bbd6-423c-bb04-292ef88365c4 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:14:21.997083 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-7fc9ea3a-bbd6-423c-bb04-292ef88365c4 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] [instance: 7b220b35-d9ac-48e4-b898-3d4f6c7be835] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:14:22.003488 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-7fc9ea3a-bbd6-423c-bb04-292ef88365c4 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:22.003967 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-7fc9ea3a-bbd6-423c-bb04-292ef88365c4 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:22.004400 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-7fc9ea3a-bbd6-423c-bb04-292ef88365c4 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:22.005083 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-7fc9ea3a-bbd6-423c-bb04-292ef88365c4 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:22.005536 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-7fc9ea3a-bbd6-423c-bb04-292ef88365c4 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:22.005961 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-7fc9ea3a-bbd6-423c-bb04-292ef88365c4 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:22.092358 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-52905ab9-352f-4dec-b11b-cba49ff85d7a tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:14:22.093515 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-52905ab9-352f-4dec-b11b-cba49ff85d7a tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 603ee2bf-bedf-4688-ac0a-77a2a50f33d7] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:14:22.100774 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-52905ab9-352f-4dec-b11b-cba49ff85d7a tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:22.101274 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-52905ab9-352f-4dec-b11b-cba49ff85d7a tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:22.101713 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-52905ab9-352f-4dec-b11b-cba49ff85d7a tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:22.102447 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-52905ab9-352f-4dec-b11b-cba49ff85d7a tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:22.103107 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-52905ab9-352f-4dec-b11b-cba49ff85d7a tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:22.103340 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-52905ab9-352f-4dec-b11b-cba49ff85d7a tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:22.134689 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-7fc9ea3a-bbd6-423c-bb04-292ef88365c4 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce25db99a7b14d0bbaca41fff80e3da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5bad80dc0d74119b2a9cd5c1935e8d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:22.143137 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-7fc9ea3a-bbd6-423c-bb04-292ef88365c4 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] 10.222.0.27 "GET /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835" status: 200 len: 1725 microversion: 2.1 time: 0.150553 Oct 17 03:14:22.143715 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 211/399] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:14:21 2022] GET /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835 => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:14:22.148846 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-9f72efea-7366-454a-b768-c025edacf65a tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:14:22.149543 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-9f72efea-7366-454a-b768-c025edacf65a tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: 712578d1-d2fb-4252-adbb-bc87096acc00] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:14:22.155911 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-9f72efea-7366-454a-b768-c025edacf65a tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:22.156400 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-9f72efea-7366-454a-b768-c025edacf65a tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:22.157002 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-9f72efea-7366-454a-b768-c025edacf65a tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:22.157877 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-9f72efea-7366-454a-b768-c025edacf65a tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:22.158496 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-9f72efea-7366-454a-b768-c025edacf65a tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:22.158963 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-9f72efea-7366-454a-b768-c025edacf65a tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:22.230804 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-9f72efea-7366-454a-b768-c025edacf65a tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1787a9ef7c44e28076aaa80c0152fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee21a91b84794e80b208fe72b7f1e010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:22.238421 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-9f72efea-7366-454a-b768-c025edacf65a tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "GET /compute/v2.1/servers/712578d1-d2fb-4252-adbb-bc87096acc00" status: 200 len: 1304 microversion: 2.1 time: 0.093730 Oct 17 03:14:22.238998 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 212/400] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:14:22 2022] GET /compute/v2.1/servers/712578d1-d2fb-4252-adbb-bc87096acc00 => generated 1304 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:14:22.250777 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-52905ab9-352f-4dec-b11b-cba49ff85d7a tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:22.259170 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-52905ab9-352f-4dec-b11b-cba49ff85d7a tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:22.260604 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-52905ab9-352f-4dec-b11b-cba49ff85d7a tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:22.261730 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-52905ab9-352f-4dec-b11b-cba49ff85d7a tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7" status: 200 len: 1740 microversion: 2.20 time: 0.173209 Oct 17 03:14:22.262267 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 189/401] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 03:14:22 2022] GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7 => generated 1740 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 03:14:22.408064 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-26418a11-e101-43bf-9f6f-a15b9efda3d3 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:14:22.408699 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-26418a11-e101-43bf-9f6f-a15b9efda3d3 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] [instance: d834c830-cb7f-43ce-ac79-2bf168e8f664] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:14:22.415218 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-26418a11-e101-43bf-9f6f-a15b9efda3d3 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:22.415698 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-26418a11-e101-43bf-9f6f-a15b9efda3d3 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:22.416125 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-26418a11-e101-43bf-9f6f-a15b9efda3d3 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:22.416814 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-26418a11-e101-43bf-9f6f-a15b9efda3d3 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:22.417257 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-26418a11-e101-43bf-9f6f-a15b9efda3d3 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:22.417673 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-26418a11-e101-43bf-9f6f-a15b9efda3d3 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:22.479204 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-26418a11-e101-43bf-9f6f-a15b9efda3d3 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c786544e8fb4e8e8c3a4990a0f36725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618cf0b3507845909bb27c13460d1d6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:22.486637 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-26418a11-e101-43bf-9f6f-a15b9efda3d3 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] 10.222.0.27 "GET /compute/v2.1/servers/d834c830-cb7f-43ce-ac79-2bf168e8f664" status: 200 len: 1294 microversion: 2.1 time: 0.082589 Oct 17 03:14:22.487221 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 213/402] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:14:22 2022] GET /compute/v2.1/servers/d834c830-cb7f-43ce-ac79-2bf168e8f664 => generated 1294 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:14:23.167522 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-045801ac-dbca-4648-a2f4-8a8464fce391 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:14:23.168125 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-045801ac-dbca-4648-a2f4-8a8464fce391 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] [instance: 7b220b35-d9ac-48e4-b898-3d4f6c7be835] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:14:23.174546 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-045801ac-dbca-4648-a2f4-8a8464fce391 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:23.175066 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-045801ac-dbca-4648-a2f4-8a8464fce391 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:23.175500 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-045801ac-dbca-4648-a2f4-8a8464fce391 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:23.176183 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-045801ac-dbca-4648-a2f4-8a8464fce391 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:23.176636 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-045801ac-dbca-4648-a2f4-8a8464fce391 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:23.177086 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-045801ac-dbca-4648-a2f4-8a8464fce391 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:23.262054 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-de603a12-508d-40ce-ad66-55820b1a086c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:14:23.262840 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-de603a12-508d-40ce-ad66-55820b1a086c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: 712578d1-d2fb-4252-adbb-bc87096acc00] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:14:23.269494 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-de603a12-508d-40ce-ad66-55820b1a086c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:23.270051 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-de603a12-508d-40ce-ad66-55820b1a086c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:23.274089 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-de603a12-508d-40ce-ad66-55820b1a086c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:23.275192 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-de603a12-508d-40ce-ad66-55820b1a086c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:23.275664 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-de603a12-508d-40ce-ad66-55820b1a086c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:23.276128 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-de603a12-508d-40ce-ad66-55820b1a086c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:23.281734 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG dbcounter [-] [118886] Writing DB stats nova_cell1:SELECT=100 {{(pid=118886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:14:23.309624 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-045801ac-dbca-4648-a2f4-8a8464fce391 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce25db99a7b14d0bbaca41fff80e3da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5bad80dc0d74119b2a9cd5c1935e8d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:23.318355 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-045801ac-dbca-4648-a2f4-8a8464fce391 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] 10.222.0.27 "GET /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835" status: 200 len: 1725 microversion: 2.1 time: 0.154073 Oct 17 03:14:23.318940 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 190/403] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:14:23 2022] GET /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835 => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:14:23.323324 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-5cd7416a-cc25-45a1-b9bf-662316a1cc72 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:14:23.323912 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-5cd7416a-cc25-45a1-b9bf-662316a1cc72 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 603ee2bf-bedf-4688-ac0a-77a2a50f33d7] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:14:23.329708 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-5cd7416a-cc25-45a1-b9bf-662316a1cc72 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:23.330382 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-5cd7416a-cc25-45a1-b9bf-662316a1cc72 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:23.330807 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-5cd7416a-cc25-45a1-b9bf-662316a1cc72 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:23.331513 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-5cd7416a-cc25-45a1-b9bf-662316a1cc72 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:23.331959 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-5cd7416a-cc25-45a1-b9bf-662316a1cc72 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:23.332373 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-5cd7416a-cc25-45a1-b9bf-662316a1cc72 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:23.344559 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-de603a12-508d-40ce-ad66-55820b1a086c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1787a9ef7c44e28076aaa80c0152fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee21a91b84794e80b208fe72b7f1e010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:23.352664 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-de603a12-508d-40ce-ad66-55820b1a086c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "GET /compute/v2.1/servers/712578d1-d2fb-4252-adbb-bc87096acc00" status: 200 len: 1304 microversion: 2.1 time: 0.094487 Oct 17 03:14:23.353228 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 214/404] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:14:23 2022] GET /compute/v2.1/servers/712578d1-d2fb-4252-adbb-bc87096acc00 => generated 1304 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:14:23.466202 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-5cd7416a-cc25-45a1-b9bf-662316a1cc72 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:23.474461 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-5cd7416a-cc25-45a1-b9bf-662316a1cc72 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:23.475927 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-5cd7416a-cc25-45a1-b9bf-662316a1cc72 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:23.477067 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-5cd7416a-cc25-45a1-b9bf-662316a1cc72 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7" status: 200 len: 1740 microversion: 2.20 time: 0.157223 Oct 17 03:14:23.477606 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 191/405] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 03:14:23 2022] GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7 => generated 1740 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:14:23.509702 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-4782b9d6-3c06-416e-be04-ffd2e86a93f9 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:14:23.510340 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-4782b9d6-3c06-416e-be04-ffd2e86a93f9 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] [instance: d834c830-cb7f-43ce-ac79-2bf168e8f664] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:14:23.517166 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-4782b9d6-3c06-416e-be04-ffd2e86a93f9 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:23.517648 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-4782b9d6-3c06-416e-be04-ffd2e86a93f9 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:23.518663 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-4782b9d6-3c06-416e-be04-ffd2e86a93f9 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:23.519389 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-4782b9d6-3c06-416e-be04-ffd2e86a93f9 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:23.519843 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-4782b9d6-3c06-416e-be04-ffd2e86a93f9 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:23.520263 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-4782b9d6-3c06-416e-be04-ffd2e86a93f9 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:23.580532 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-4782b9d6-3c06-416e-be04-ffd2e86a93f9 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c786544e8fb4e8e8c3a4990a0f36725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618cf0b3507845909bb27c13460d1d6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:23.588057 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-4782b9d6-3c06-416e-be04-ffd2e86a93f9 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] 10.222.0.27 "GET /compute/v2.1/servers/d834c830-cb7f-43ce-ac79-2bf168e8f664" status: 200 len: 1294 microversion: 2.1 time: 0.082193 Oct 17 03:14:23.588618 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 215/406] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:14:23 2022] GET /compute/v2.1/servers/d834c830-cb7f-43ce-ac79-2bf168e8f664 => generated 1294 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:14:24.342063 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-ac6496bb-60d1-4fef-89a1-ae55b9b47f28 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:14:24.343117 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-ac6496bb-60d1-4fef-89a1-ae55b9b47f28 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] [instance: 7b220b35-d9ac-48e4-b898-3d4f6c7be835] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:14:24.350211 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-ac6496bb-60d1-4fef-89a1-ae55b9b47f28 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:24.350803 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-ac6496bb-60d1-4fef-89a1-ae55b9b47f28 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:24.351323 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-ac6496bb-60d1-4fef-89a1-ae55b9b47f28 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:24.352087 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-ac6496bb-60d1-4fef-89a1-ae55b9b47f28 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:24.353020 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-ac6496bb-60d1-4fef-89a1-ae55b9b47f28 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:24.353511 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-ac6496bb-60d1-4fef-89a1-ae55b9b47f28 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:24.379665 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-34f6e06a-8e42-49a2-a5ab-f6b2c2624600 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:14:24.382693 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-34f6e06a-8e42-49a2-a5ab-f6b2c2624600 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: 712578d1-d2fb-4252-adbb-bc87096acc00] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:14:24.397979 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-34f6e06a-8e42-49a2-a5ab-f6b2c2624600 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:24.398474 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-34f6e06a-8e42-49a2-a5ab-f6b2c2624600 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:24.399025 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-34f6e06a-8e42-49a2-a5ab-f6b2c2624600 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:24.399674 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-34f6e06a-8e42-49a2-a5ab-f6b2c2624600 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:24.400132 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-34f6e06a-8e42-49a2-a5ab-f6b2c2624600 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:24.400554 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-34f6e06a-8e42-49a2-a5ab-f6b2c2624600 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:24.522830 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-34f6e06a-8e42-49a2-a5ab-f6b2c2624600 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1787a9ef7c44e28076aaa80c0152fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee21a91b84794e80b208fe72b7f1e010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:24.536165 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-34f6e06a-8e42-49a2-a5ab-f6b2c2624600 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "GET /compute/v2.1/servers/712578d1-d2fb-4252-adbb-bc87096acc00" status: 200 len: 1302 microversion: 2.1 time: 0.164395 Oct 17 03:14:24.536772 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 216/407] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:14:24 2022] GET /compute/v2.1/servers/712578d1-d2fb-4252-adbb-bc87096acc00 => generated 1302 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:14:24.541847 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-a16401fe-bda3-4bb2-8aeb-6164027bb752 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:14:24.542686 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-a16401fe-bda3-4bb2-8aeb-6164027bb752 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 603ee2bf-bedf-4688-ac0a-77a2a50f33d7] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:14:24.549155 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-a16401fe-bda3-4bb2-8aeb-6164027bb752 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:24.549915 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-a16401fe-bda3-4bb2-8aeb-6164027bb752 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:24.550365 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-a16401fe-bda3-4bb2-8aeb-6164027bb752 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:24.551321 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-a16401fe-bda3-4bb2-8aeb-6164027bb752 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:24.551845 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-a16401fe-bda3-4bb2-8aeb-6164027bb752 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:24.552623 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-a16401fe-bda3-4bb2-8aeb-6164027bb752 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:24.666967 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-ac6496bb-60d1-4fef-89a1-ae55b9b47f28 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce25db99a7b14d0bbaca41fff80e3da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5bad80dc0d74119b2a9cd5c1935e8d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:24.681282 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-ac6496bb-60d1-4fef-89a1-ae55b9b47f28 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] 10.222.0.27 "GET /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835" status: 200 len: 1702 microversion: 2.1 time: 0.343128 Oct 17 03:14:24.683394 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 192/408] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:14:24 2022] GET /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835 => generated 1702 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:14:24.688593 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-02bc7e9a-affa-4ca6-bca3-2563a67afc2b tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:14:24.689957 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-02bc7e9a-affa-4ca6-bca3-2563a67afc2b tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] [instance: d834c830-cb7f-43ce-ac79-2bf168e8f664] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:14:24.697082 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-02bc7e9a-affa-4ca6-bca3-2563a67afc2b tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:24.697912 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-02bc7e9a-affa-4ca6-bca3-2563a67afc2b tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:24.698632 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-02bc7e9a-affa-4ca6-bca3-2563a67afc2b tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:24.700591 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-02bc7e9a-affa-4ca6-bca3-2563a67afc2b tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:24.701367 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-02bc7e9a-affa-4ca6-bca3-2563a67afc2b tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:24.702004 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-02bc7e9a-affa-4ca6-bca3-2563a67afc2b tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:24.801374 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-a16401fe-bda3-4bb2-8aeb-6164027bb752 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:24.813507 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-a16401fe-bda3-4bb2-8aeb-6164027bb752 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:24.816541 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-a16401fe-bda3-4bb2-8aeb-6164027bb752 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:24.819666 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-a16401fe-bda3-4bb2-8aeb-6164027bb752 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7" status: 200 len: 1722 microversion: 2.20 time: 0.281740 Oct 17 03:14:24.824077 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 217/409] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 03:14:24 2022] GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7 => generated 1722 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:14:24.834401 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-02bc7e9a-affa-4ca6-bca3-2563a67afc2b tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c786544e8fb4e8e8c3a4990a0f36725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618cf0b3507845909bb27c13460d1d6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:24.851165 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-9335e55e-4d1a-425b-83e8-6a5c631b0f51 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:14:24.857912 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-9335e55e-4d1a-425b-83e8-6a5c631b0f51 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:24.858387 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-9335e55e-4d1a-425b-83e8-6a5c631b0f51 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:24.858820 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-9335e55e-4d1a-425b-83e8-6a5c631b0f51 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:24.861975 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-02bc7e9a-affa-4ca6-bca3-2563a67afc2b tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] 10.222.0.27 "GET /compute/v2.1/servers/d834c830-cb7f-43ce-ac79-2bf168e8f664" status: 200 len: 1294 microversion: 2.1 time: 0.176505 Oct 17 03:14:24.863104 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 193/410] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:14:24 2022] GET /compute/v2.1/servers/d834c830-cb7f-43ce-ac79-2bf168e8f664 => generated 1294 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:14:24.888743 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-9335e55e-4d1a-425b-83e8-6a5c631b0f51 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] [instance: 7b220b35-d9ac-48e4-b898-3d4f6c7be835] Going to try to start instance {{(pid=118886) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 17 03:14:24.942456 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-9335e55e-4d1a-425b-83e8-6a5c631b0f51 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] 10.222.0.27 "POST /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835/action" status: 202 len: 0 microversion: 2.1 time: 0.105858 Oct 17 03:14:24.944025 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 218/411] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 03:14:24 2022] POST /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 03:14:24.953064 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-16d91a3c-39f9-4783-9184-b1e60edcb558 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:14:24.954001 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-16d91a3c-39f9-4783-9184-b1e60edcb558 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] [instance: 7b220b35-d9ac-48e4-b898-3d4f6c7be835] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:14:24.963441 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-16d91a3c-39f9-4783-9184-b1e60edcb558 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:24.964487 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-16d91a3c-39f9-4783-9184-b1e60edcb558 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:24.965183 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-16d91a3c-39f9-4783-9184-b1e60edcb558 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:24.966445 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-16d91a3c-39f9-4783-9184-b1e60edcb558 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:24.967195 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-16d91a3c-39f9-4783-9184-b1e60edcb558 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:24.968205 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-16d91a3c-39f9-4783-9184-b1e60edcb558 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:25.374825 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-16d91a3c-39f9-4783-9184-b1e60edcb558 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce25db99a7b14d0bbaca41fff80e3da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5bad80dc0d74119b2a9cd5c1935e8d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:25.385450 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-16d91a3c-39f9-4783-9184-b1e60edcb558 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] 10.222.0.27 "GET /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835" status: 200 len: 1711 microversion: 2.1 time: 0.437051 Oct 17 03:14:25.386008 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 194/412] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:14:24 2022] GET /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835 => generated 1711 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:14:25.560240 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-fba0f50e-245e-4757-8680-4c5be9a9680b tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:14:25.560907 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-fba0f50e-245e-4757-8680-4c5be9a9680b tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: 712578d1-d2fb-4252-adbb-bc87096acc00] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:14:25.567583 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-fba0f50e-245e-4757-8680-4c5be9a9680b tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:25.568596 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-fba0f50e-245e-4757-8680-4c5be9a9680b tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:25.569253 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-fba0f50e-245e-4757-8680-4c5be9a9680b tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:25.569725 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-fba0f50e-245e-4757-8680-4c5be9a9680b tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:25.570173 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-fba0f50e-245e-4757-8680-4c5be9a9680b tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:25.570594 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-fba0f50e-245e-4757-8680-4c5be9a9680b tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:25.719424 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-fba0f50e-245e-4757-8680-4c5be9a9680b tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1787a9ef7c44e28076aaa80c0152fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee21a91b84794e80b208fe72b7f1e010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:25.727542 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-fba0f50e-245e-4757-8680-4c5be9a9680b tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "GET /compute/v2.1/servers/712578d1-d2fb-4252-adbb-bc87096acc00" status: 200 len: 1369 microversion: 2.1 time: 0.171912 Oct 17 03:14:25.734704 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 219/413] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:14:25 2022] GET /compute/v2.1/servers/712578d1-d2fb-4252-adbb-bc87096acc00 => generated 1369 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:14:25.853871 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-1882df57-8490-4538-812f-d408ae578bb7 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:14:25.854596 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-1882df57-8490-4538-812f-d408ae578bb7 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 603ee2bf-bedf-4688-ac0a-77a2a50f33d7] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:14:25.860987 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-1882df57-8490-4538-812f-d408ae578bb7 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:25.862148 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-1882df57-8490-4538-812f-d408ae578bb7 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:25.862692 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-1882df57-8490-4538-812f-d408ae578bb7 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:25.863655 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-1882df57-8490-4538-812f-d408ae578bb7 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:25.864254 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-1882df57-8490-4538-812f-d408ae578bb7 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:25.865772 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-1882df57-8490-4538-812f-d408ae578bb7 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:25.886555 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-f1e65c10-d8e7-4ff7-a19d-064181db3ba5 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:14:25.887449 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-f1e65c10-d8e7-4ff7-a19d-064181db3ba5 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] [instance: d834c830-cb7f-43ce-ac79-2bf168e8f664] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:14:25.893563 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-f1e65c10-d8e7-4ff7-a19d-064181db3ba5 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:25.894355 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-f1e65c10-d8e7-4ff7-a19d-064181db3ba5 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:25.894846 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-f1e65c10-d8e7-4ff7-a19d-064181db3ba5 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:25.895510 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-f1e65c10-d8e7-4ff7-a19d-064181db3ba5 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:25.896021 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-f1e65c10-d8e7-4ff7-a19d-064181db3ba5 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:25.896451 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-f1e65c10-d8e7-4ff7-a19d-064181db3ba5 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:25.959565 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-f1e65c10-d8e7-4ff7-a19d-064181db3ba5 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c786544e8fb4e8e8c3a4990a0f36725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618cf0b3507845909bb27c13460d1d6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:25.970478 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-f1e65c10-d8e7-4ff7-a19d-064181db3ba5 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] 10.222.0.27 "GET /compute/v2.1/servers/d834c830-cb7f-43ce-ac79-2bf168e8f664" status: 200 len: 1300 microversion: 2.1 time: 0.087722 Oct 17 03:14:25.971433 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 220/414] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:14:25 2022] GET /compute/v2.1/servers/d834c830-cb7f-43ce-ac79-2bf168e8f664 => generated 1300 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:14:26.050400 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-1882df57-8490-4538-812f-d408ae578bb7 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:26.062559 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-1882df57-8490-4538-812f-d408ae578bb7 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:26.064051 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-1882df57-8490-4538-812f-d408ae578bb7 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:26.065209 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-1882df57-8490-4538-812f-d408ae578bb7 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7" status: 200 len: 1722 microversion: 2.20 time: 0.216269 Oct 17 03:14:26.065989 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 195/415] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 03:14:25 2022] GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7 => generated 1722 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:14:26.409736 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-abac2b3d-1a88-4642-b3e2-6596e3d6f08e tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:14:26.410346 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-abac2b3d-1a88-4642-b3e2-6596e3d6f08e tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] [instance: 7b220b35-d9ac-48e4-b898-3d4f6c7be835] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:14:26.416760 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-abac2b3d-1a88-4642-b3e2-6596e3d6f08e tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:26.417234 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-abac2b3d-1a88-4642-b3e2-6596e3d6f08e tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:26.417657 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-abac2b3d-1a88-4642-b3e2-6596e3d6f08e tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:26.418337 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-abac2b3d-1a88-4642-b3e2-6596e3d6f08e tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:26.418785 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-abac2b3d-1a88-4642-b3e2-6596e3d6f08e tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:26.419224 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-abac2b3d-1a88-4642-b3e2-6596e3d6f08e tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:26.550952 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-abac2b3d-1a88-4642-b3e2-6596e3d6f08e tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce25db99a7b14d0bbaca41fff80e3da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5bad80dc0d74119b2a9cd5c1935e8d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:26.559791 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-abac2b3d-1a88-4642-b3e2-6596e3d6f08e tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] 10.222.0.27 "GET /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835" status: 200 len: 1711 microversion: 2.1 time: 0.154011 Oct 17 03:14:26.560389 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 221/416] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:14:26 2022] GET /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835 => generated 1711 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:14:26.751385 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-57c67553-f4ad-4e62-9425-6252c191810d tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:14:26.752025 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-57c67553-f4ad-4e62-9425-6252c191810d tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: 712578d1-d2fb-4252-adbb-bc87096acc00] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:14:26.759621 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-57c67553-f4ad-4e62-9425-6252c191810d tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:26.760100 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-57c67553-f4ad-4e62-9425-6252c191810d tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:26.760531 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-57c67553-f4ad-4e62-9425-6252c191810d tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:26.761217 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-57c67553-f4ad-4e62-9425-6252c191810d tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:26.761665 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-57c67553-f4ad-4e62-9425-6252c191810d tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:26.762080 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-57c67553-f4ad-4e62-9425-6252c191810d tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:26.878215 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG dbcounter [-] [118887] Writing DB stats nova_cell0:SELECT=2 {{(pid=118887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:14:26.898060 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-57c67553-f4ad-4e62-9425-6252c191810d tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1787a9ef7c44e28076aaa80c0152fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee21a91b84794e80b208fe72b7f1e010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:26.906545 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-57c67553-f4ad-4e62-9425-6252c191810d tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "GET /compute/v2.1/servers/712578d1-d2fb-4252-adbb-bc87096acc00" status: 200 len: 1369 microversion: 2.1 time: 0.159019 Oct 17 03:14:26.907221 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 196/417] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:14:26 2022] GET /compute/v2.1/servers/712578d1-d2fb-4252-adbb-bc87096acc00 => generated 1369 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:14:26.995725 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-f47ffc21-5838-4aa3-a000-6c93d95beb6b tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:14:26.996431 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-f47ffc21-5838-4aa3-a000-6c93d95beb6b tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] [instance: d834c830-cb7f-43ce-ac79-2bf168e8f664] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:14:26.998463 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG dbcounter [-] [118886] Writing DB stats nova_cell0:SELECT=2 {{(pid=118886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:14:27.003545 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-f47ffc21-5838-4aa3-a000-6c93d95beb6b tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:27.004021 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-f47ffc21-5838-4aa3-a000-6c93d95beb6b tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:27.004448 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-f47ffc21-5838-4aa3-a000-6c93d95beb6b tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:27.005680 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-f47ffc21-5838-4aa3-a000-6c93d95beb6b tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:27.006228 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-f47ffc21-5838-4aa3-a000-6c93d95beb6b tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:27.006859 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-f47ffc21-5838-4aa3-a000-6c93d95beb6b tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:27.078746 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-f47ffc21-5838-4aa3-a000-6c93d95beb6b tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c786544e8fb4e8e8c3a4990a0f36725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618cf0b3507845909bb27c13460d1d6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:27.089779 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-f47ffc21-5838-4aa3-a000-6c93d95beb6b tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] 10.222.0.27 "GET /compute/v2.1/servers/d834c830-cb7f-43ce-ac79-2bf168e8f664" status: 200 len: 1300 microversion: 2.1 time: 0.097827 Oct 17 03:14:27.090670 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 222/418] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:14:26 2022] GET /compute/v2.1/servers/d834c830-cb7f-43ce-ac79-2bf168e8f664 => generated 1300 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:14:27.108268 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-37235357-7787-4010-9cfa-be5b2d6e4cb8 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:14:27.108903 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-37235357-7787-4010-9cfa-be5b2d6e4cb8 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 603ee2bf-bedf-4688-ac0a-77a2a50f33d7] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:14:27.114440 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-37235357-7787-4010-9cfa-be5b2d6e4cb8 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:27.115462 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-37235357-7787-4010-9cfa-be5b2d6e4cb8 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:27.115891 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-37235357-7787-4010-9cfa-be5b2d6e4cb8 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:27.116586 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-37235357-7787-4010-9cfa-be5b2d6e4cb8 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:27.117043 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-37235357-7787-4010-9cfa-be5b2d6e4cb8 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:27.117468 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-37235357-7787-4010-9cfa-be5b2d6e4cb8 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:27.121559 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG dbcounter [-] [118887] Writing DB stats nova_cell1:SELECT=100 {{(pid=118887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:14:27.250707 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-37235357-7787-4010-9cfa-be5b2d6e4cb8 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:27.258740 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-37235357-7787-4010-9cfa-be5b2d6e4cb8 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:27.260202 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-37235357-7787-4010-9cfa-be5b2d6e4cb8 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:27.261360 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-37235357-7787-4010-9cfa-be5b2d6e4cb8 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7" status: 200 len: 1722 microversion: 2.20 time: 0.174214 Oct 17 03:14:27.261922 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 197/419] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 03:14:27 2022] GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7 => generated 1722 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 03:14:27.583213 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-cc26b828-6e81-4651-96a0-9058f2f762ca tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:14:27.584380 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-cc26b828-6e81-4651-96a0-9058f2f762ca tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] [instance: 7b220b35-d9ac-48e4-b898-3d4f6c7be835] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:14:27.586209 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG dbcounter [-] [118886] Writing DB stats nova_cell0:SELECT=12 {{(pid=118886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:14:27.591951 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-cc26b828-6e81-4651-96a0-9058f2f762ca tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:27.592523 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-cc26b828-6e81-4651-96a0-9058f2f762ca tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:27.592997 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-cc26b828-6e81-4651-96a0-9058f2f762ca tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:27.593752 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-cc26b828-6e81-4651-96a0-9058f2f762ca tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:27.594197 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-cc26b828-6e81-4651-96a0-9058f2f762ca tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:27.594599 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-cc26b828-6e81-4651-96a0-9058f2f762ca tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:27.930903 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-75a34239-450a-45f5-a798-39b899f37395 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:14:27.932608 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-75a34239-450a-45f5-a798-39b899f37395 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: 712578d1-d2fb-4252-adbb-bc87096acc00] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:14:27.940175 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG dbcounter [-] [118887] Writing DB stats nova_cell0:SELECT=12 {{(pid=118887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:14:27.942327 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-75a34239-450a-45f5-a798-39b899f37395 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:27.943581 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-75a34239-450a-45f5-a798-39b899f37395 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:27.944070 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-75a34239-450a-45f5-a798-39b899f37395 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:27.944760 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-75a34239-450a-45f5-a798-39b899f37395 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:27.945213 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-75a34239-450a-45f5-a798-39b899f37395 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:27.945634 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-75a34239-450a-45f5-a798-39b899f37395 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:28.061029 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-cc26b828-6e81-4651-96a0-9058f2f762ca tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce25db99a7b14d0bbaca41fff80e3da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5bad80dc0d74119b2a9cd5c1935e8d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:28.071378 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-cc26b828-6e81-4651-96a0-9058f2f762ca tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] 10.222.0.27 "GET /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835" status: 200 len: 1711 microversion: 2.1 time: 0.491897 Oct 17 03:14:28.071956 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 223/420] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:14:27 2022] GET /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835 => generated 1711 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:14:28.114046 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-2288e9ef-510d-4c3d-b623-de0366a3feca tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:14:28.115549 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-2288e9ef-510d-4c3d-b623-de0366a3feca tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] [instance: d834c830-cb7f-43ce-ac79-2bf168e8f664] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:14:28.121935 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-2288e9ef-510d-4c3d-b623-de0366a3feca tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:28.122630 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-2288e9ef-510d-4c3d-b623-de0366a3feca tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:28.123316 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-2288e9ef-510d-4c3d-b623-de0366a3feca tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:28.124721 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-2288e9ef-510d-4c3d-b623-de0366a3feca tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:28.125577 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-2288e9ef-510d-4c3d-b623-de0366a3feca tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:28.126414 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-2288e9ef-510d-4c3d-b623-de0366a3feca tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:28.231176 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-2288e9ef-510d-4c3d-b623-de0366a3feca tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c786544e8fb4e8e8c3a4990a0f36725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618cf0b3507845909bb27c13460d1d6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:28.241707 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-2288e9ef-510d-4c3d-b623-de0366a3feca tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] 10.222.0.27 "GET /compute/v2.1/servers/d834c830-cb7f-43ce-ac79-2bf168e8f664" status: 200 len: 1300 microversion: 2.1 time: 0.131977 Oct 17 03:14:28.255199 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 224/421] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:14:28 2022] GET /compute/v2.1/servers/d834c830-cb7f-43ce-ac79-2bf168e8f664 => generated 1300 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:14:28.289193 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-d9c54d39-649a-4505-8e84-6691d2924d37 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:14:28.289516 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-d9c54d39-649a-4505-8e84-6691d2924d37 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 603ee2bf-bedf-4688-ac0a-77a2a50f33d7] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:14:28.296800 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-d9c54d39-649a-4505-8e84-6691d2924d37 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:28.297295 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-d9c54d39-649a-4505-8e84-6691d2924d37 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:28.297727 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-d9c54d39-649a-4505-8e84-6691d2924d37 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:28.298421 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-d9c54d39-649a-4505-8e84-6691d2924d37 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:28.299097 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-d9c54d39-649a-4505-8e84-6691d2924d37 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:28.299673 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-d9c54d39-649a-4505-8e84-6691d2924d37 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:28.358179 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-75a34239-450a-45f5-a798-39b899f37395 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1787a9ef7c44e28076aaa80c0152fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee21a91b84794e80b208fe72b7f1e010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:28.367029 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-75a34239-450a-45f5-a798-39b899f37395 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "GET /compute/v2.1/servers/712578d1-d2fb-4252-adbb-bc87096acc00" status: 200 len: 1369 microversion: 2.1 time: 0.441670 Oct 17 03:14:28.381014 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 198/422] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:14:27 2022] GET /compute/v2.1/servers/712578d1-d2fb-4252-adbb-bc87096acc00 => generated 1369 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:14:28.556782 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-d9c54d39-649a-4505-8e84-6691d2924d37 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:28.565863 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-d9c54d39-649a-4505-8e84-6691d2924d37 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:28.567819 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-d9c54d39-649a-4505-8e84-6691d2924d37 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:28.569682 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-d9c54d39-649a-4505-8e84-6691d2924d37 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7" status: 200 len: 1722 microversion: 2.20 time: 0.285207 Oct 17 03:14:28.570603 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 225/423] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 03:14:28 2022] GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7 => generated 1722 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:14:29.095746 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-1a018a84-383d-4295-b010-04b581624cdb tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:14:29.096295 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-1a018a84-383d-4295-b010-04b581624cdb tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] [instance: 7b220b35-d9ac-48e4-b898-3d4f6c7be835] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:14:29.103058 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-1a018a84-383d-4295-b010-04b581624cdb tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:29.103549 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-1a018a84-383d-4295-b010-04b581624cdb tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:29.104094 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-1a018a84-383d-4295-b010-04b581624cdb tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:29.104806 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-1a018a84-383d-4295-b010-04b581624cdb tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:29.105258 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-1a018a84-383d-4295-b010-04b581624cdb tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:29.105721 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-1a018a84-383d-4295-b010-04b581624cdb tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:29.266008 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-aca33ab6-e3e4-4453-924e-ec55f4574ba8 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:14:29.267257 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-aca33ab6-e3e4-4453-924e-ec55f4574ba8 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] [instance: d834c830-cb7f-43ce-ac79-2bf168e8f664] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:14:29.275226 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-aca33ab6-e3e4-4453-924e-ec55f4574ba8 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:29.275906 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-aca33ab6-e3e4-4453-924e-ec55f4574ba8 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:29.276488 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-aca33ab6-e3e4-4453-924e-ec55f4574ba8 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:29.277343 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-aca33ab6-e3e4-4453-924e-ec55f4574ba8 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:29.277946 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-aca33ab6-e3e4-4453-924e-ec55f4574ba8 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:29.278513 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-aca33ab6-e3e4-4453-924e-ec55f4574ba8 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:29.346834 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-aca33ab6-e3e4-4453-924e-ec55f4574ba8 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c786544e8fb4e8e8c3a4990a0f36725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618cf0b3507845909bb27c13460d1d6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:29.355545 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-aca33ab6-e3e4-4453-924e-ec55f4574ba8 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] 10.222.0.27 "GET /compute/v2.1/servers/d834c830-cb7f-43ce-ac79-2bf168e8f664" status: 200 len: 1300 microversion: 2.1 time: 0.093906 Oct 17 03:14:29.356121 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 226/424] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:14:29 2022] GET /compute/v2.1/servers/d834c830-cb7f-43ce-ac79-2bf168e8f664 => generated 1300 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:14:29.391510 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-fa16c1b8-3f96-4b21-9cb3-639af146a8c9 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:14:29.392228 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-fa16c1b8-3f96-4b21-9cb3-639af146a8c9 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: 712578d1-d2fb-4252-adbb-bc87096acc00] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:14:29.398389 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-fa16c1b8-3f96-4b21-9cb3-639af146a8c9 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:29.398880 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-fa16c1b8-3f96-4b21-9cb3-639af146a8c9 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:29.399328 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-fa16c1b8-3f96-4b21-9cb3-639af146a8c9 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:29.400094 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-fa16c1b8-3f96-4b21-9cb3-639af146a8c9 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:29.400550 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-fa16c1b8-3f96-4b21-9cb3-639af146a8c9 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:29.400984 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-fa16c1b8-3f96-4b21-9cb3-639af146a8c9 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:29.459491 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-1a018a84-383d-4295-b010-04b581624cdb tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce25db99a7b14d0bbaca41fff80e3da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5bad80dc0d74119b2a9cd5c1935e8d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:29.469944 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-1a018a84-383d-4295-b010-04b581624cdb tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] 10.222.0.27 "GET /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835" status: 200 len: 1711 microversion: 2.1 time: 0.378154 Oct 17 03:14:29.471168 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 199/425] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:14:29 2022] GET /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835 => generated 1711 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:14:29.542504 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-fa16c1b8-3f96-4b21-9cb3-639af146a8c9 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1787a9ef7c44e28076aaa80c0152fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee21a91b84794e80b208fe72b7f1e010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:29.550292 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-fa16c1b8-3f96-4b21-9cb3-639af146a8c9 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "GET /compute/v2.1/servers/712578d1-d2fb-4252-adbb-bc87096acc00" status: 200 len: 1369 microversion: 2.1 time: 0.162684 Oct 17 03:14:29.550958 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 227/426] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:14:29 2022] GET /compute/v2.1/servers/712578d1-d2fb-4252-adbb-bc87096acc00 => generated 1369 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:14:29.598433 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-b0539812-ba13-480a-91e5-9b23bb56ab1d tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:14:29.599642 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-b0539812-ba13-480a-91e5-9b23bb56ab1d tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 603ee2bf-bedf-4688-ac0a-77a2a50f33d7] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:14:29.605624 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-b0539812-ba13-480a-91e5-9b23bb56ab1d tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:29.606098 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-b0539812-ba13-480a-91e5-9b23bb56ab1d tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:29.606519 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-b0539812-ba13-480a-91e5-9b23bb56ab1d tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:29.607414 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-b0539812-ba13-480a-91e5-9b23bb56ab1d tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:29.607862 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-b0539812-ba13-480a-91e5-9b23bb56ab1d tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:29.608278 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-b0539812-ba13-480a-91e5-9b23bb56ab1d tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:29.745743 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [req-0763c4a9-d784-49d4-bf54-a13c2fccc312 req-3950dbd3-22e0-46ae-bb34-21110b21930a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "712578d1-d2fb-4252-adbb-bc87096acc00", "tag": "f7a1e8a6-f7aa-40af-a627-0640f636cc4a"}]} {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:14:29.757320 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [req-0763c4a9-d784-49d4-bf54-a13c2fccc312 req-3950dbd3-22e0-46ae-bb34-21110b21930a service nova] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:29.757928 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [req-0763c4a9-d784-49d4-bf54-a13c2fccc312 req-3950dbd3-22e0-46ae-bb34-21110b21930a service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:29.758473 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [req-0763c4a9-d784-49d4-bf54-a13c2fccc312 req-3950dbd3-22e0-46ae-bb34-21110b21930a service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:29.774650 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.compute.server_external_events [req-0763c4a9-d784-49d4-bf54-a13c2fccc312 req-3950dbd3-22e0-46ae-bb34-21110b21930a service nova] Creating event network-changed:f7a1e8a6-f7aa-40af-a627-0640f636cc4a for instance 712578d1-d2fb-4252-adbb-bc87096acc00 on hv-cinder-84697 Oct 17 03:14:29.780124 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [req-0763c4a9-d784-49d4-bf54-a13c2fccc312 req-3950dbd3-22e0-46ae-bb34-21110b21930a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038123 Oct 17 03:14:29.780862 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 228/427] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 03:14:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 03:14:29.842972 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-b0539812-ba13-480a-91e5-9b23bb56ab1d tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:29.851683 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-b0539812-ba13-480a-91e5-9b23bb56ab1d tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:29.853075 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-b0539812-ba13-480a-91e5-9b23bb56ab1d tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:29.854216 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-b0539812-ba13-480a-91e5-9b23bb56ab1d tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7" status: 200 len: 1722 microversion: 2.20 time: 0.260384 Oct 17 03:14:29.854782 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 200/428] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 03:14:29 2022] GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7 => generated 1722 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:14:30.382730 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-3f5ee9ba-36bb-43c1-9141-c1792e68ec23 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:14:30.383402 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-3f5ee9ba-36bb-43c1-9141-c1792e68ec23 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] [instance: d834c830-cb7f-43ce-ac79-2bf168e8f664] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:14:30.390044 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-3f5ee9ba-36bb-43c1-9141-c1792e68ec23 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:30.390534 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-3f5ee9ba-36bb-43c1-9141-c1792e68ec23 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:30.391005 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-3f5ee9ba-36bb-43c1-9141-c1792e68ec23 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:30.391699 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-3f5ee9ba-36bb-43c1-9141-c1792e68ec23 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:30.392344 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-3f5ee9ba-36bb-43c1-9141-c1792e68ec23 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:30.392915 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-3f5ee9ba-36bb-43c1-9141-c1792e68ec23 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:30.494095 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-c1d8e8b4-0c61-44d3-be36-5f0441399f80 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:14:30.494704 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-c1d8e8b4-0c61-44d3-be36-5f0441399f80 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] [instance: 7b220b35-d9ac-48e4-b898-3d4f6c7be835] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:14:30.501048 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-c1d8e8b4-0c61-44d3-be36-5f0441399f80 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:30.501544 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-c1d8e8b4-0c61-44d3-be36-5f0441399f80 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:30.501976 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-c1d8e8b4-0c61-44d3-be36-5f0441399f80 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:30.502676 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-c1d8e8b4-0c61-44d3-be36-5f0441399f80 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:30.503152 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-c1d8e8b4-0c61-44d3-be36-5f0441399f80 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:30.503574 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-c1d8e8b4-0c61-44d3-be36-5f0441399f80 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:30.520628 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-3f5ee9ba-36bb-43c1-9141-c1792e68ec23 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c786544e8fb4e8e8c3a4990a0f36725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618cf0b3507845909bb27c13460d1d6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:30.528686 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-3f5ee9ba-36bb-43c1-9141-c1792e68ec23 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] 10.222.0.27 "GET /compute/v2.1/servers/d834c830-cb7f-43ce-ac79-2bf168e8f664" status: 200 len: 1368 microversion: 2.1 time: 0.151698 Oct 17 03:14:30.529255 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 229/429] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:14:30 2022] GET /compute/v2.1/servers/d834c830-cb7f-43ce-ac79-2bf168e8f664 => generated 1368 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:14:30.573163 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-9a8f88da-4cce-4062-945c-f2a4bc59cf9b tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:14:30.573880 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-9a8f88da-4cce-4062-945c-f2a4bc59cf9b tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: 712578d1-d2fb-4252-adbb-bc87096acc00] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:14:30.579884 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-9a8f88da-4cce-4062-945c-f2a4bc59cf9b tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:30.580446 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-9a8f88da-4cce-4062-945c-f2a4bc59cf9b tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:30.580952 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-9a8f88da-4cce-4062-945c-f2a4bc59cf9b tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:30.581811 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-9a8f88da-4cce-4062-945c-f2a4bc59cf9b tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:30.582342 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-9a8f88da-4cce-4062-945c-f2a4bc59cf9b tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:30.582845 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-9a8f88da-4cce-4062-945c-f2a4bc59cf9b tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:30.602294 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG dbcounter [-] [118886] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:14:30.635333 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-c1d8e8b4-0c61-44d3-be36-5f0441399f80 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce25db99a7b14d0bbaca41fff80e3da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5bad80dc0d74119b2a9cd5c1935e8d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:30.643494 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-c1d8e8b4-0c61-44d3-be36-5f0441399f80 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] 10.222.0.27 "GET /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835" status: 200 len: 1711 microversion: 2.1 time: 0.154022 Oct 17 03:14:30.644057 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 201/430] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:14:30 2022] GET /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835 => generated 1711 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:14:30.716293 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-9a8f88da-4cce-4062-945c-f2a4bc59cf9b tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1787a9ef7c44e28076aaa80c0152fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee21a91b84794e80b208fe72b7f1e010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:30.723949 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-9a8f88da-4cce-4062-945c-f2a4bc59cf9b tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "GET /compute/v2.1/servers/712578d1-d2fb-4252-adbb-bc87096acc00" status: 200 len: 1369 microversion: 2.1 time: 0.154553 Oct 17 03:14:30.724641 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 230/431] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:14:30 2022] GET /compute/v2.1/servers/712578d1-d2fb-4252-adbb-bc87096acc00 => generated 1369 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:14:30.882405 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-d13be06a-9010-4428-868c-7a0a4cefa2d0 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:14:30.883270 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-d13be06a-9010-4428-868c-7a0a4cefa2d0 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 603ee2bf-bedf-4688-ac0a-77a2a50f33d7] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:14:30.890142 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-d13be06a-9010-4428-868c-7a0a4cefa2d0 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:30.890588 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-d13be06a-9010-4428-868c-7a0a4cefa2d0 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:30.891048 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-d13be06a-9010-4428-868c-7a0a4cefa2d0 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:30.891893 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-d13be06a-9010-4428-868c-7a0a4cefa2d0 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:30.892779 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-d13be06a-9010-4428-868c-7a0a4cefa2d0 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:30.893474 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-d13be06a-9010-4428-868c-7a0a4cefa2d0 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:31.115625 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-d13be06a-9010-4428-868c-7a0a4cefa2d0 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:31.124829 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-d13be06a-9010-4428-868c-7a0a4cefa2d0 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:31.126628 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-d13be06a-9010-4428-868c-7a0a4cefa2d0 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:31.127977 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-d13be06a-9010-4428-868c-7a0a4cefa2d0 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7" status: 200 len: 1725 microversion: 2.20 time: 0.251754 Oct 17 03:14:31.128589 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 202/432] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 03:14:30 2022] GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7 => generated 1725 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:14:31.155393 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-e48c5a21-8be2-4692-a3f8-897ff9f66236 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f45fb229-2f3c-498d-a9c1-b264895c8a3e"}} {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:14:31.158127 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-e48c5a21-8be2-4692-a3f8-897ff9f66236 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 603ee2bf-bedf-4688-ac0a-77a2a50f33d7] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:14:31.165615 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-e48c5a21-8be2-4692-a3f8-897ff9f66236 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:31.171992 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-e48c5a21-8be2-4692-a3f8-897ff9f66236 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:31.172590 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-e48c5a21-8be2-4692-a3f8-897ff9f66236 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:31.174276 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-e48c5a21-8be2-4692-a3f8-897ff9f66236 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:31.175239 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-e48c5a21-8be2-4692-a3f8-897ff9f66236 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:31.175939 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-e48c5a21-8be2-4692-a3f8-897ff9f66236 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:31.553055 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-92eb28e1-4226-461b-8204-97a1bf2711c0 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:14:31.553971 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-92eb28e1-4226-461b-8204-97a1bf2711c0 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] [instance: d834c830-cb7f-43ce-ac79-2bf168e8f664] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:14:31.560933 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-92eb28e1-4226-461b-8204-97a1bf2711c0 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:31.561682 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-92eb28e1-4226-461b-8204-97a1bf2711c0 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:31.562351 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-92eb28e1-4226-461b-8204-97a1bf2711c0 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:31.563291 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-92eb28e1-4226-461b-8204-97a1bf2711c0 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:31.563955 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-92eb28e1-4226-461b-8204-97a1bf2711c0 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:31.564468 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-92eb28e1-4226-461b-8204-97a1bf2711c0 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:31.584419 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-e48c5a21-8be2-4692-a3f8-897ff9f66236 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "POST /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.433323 Oct 17 03:14:31.590611 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 231/433] 10.222.0.27 () {62 vars in 1364 bytes} [Mon Oct 17 03:14:31 2022] POST /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7/os-volume_attachments => generated 188 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 03:14:31.670132 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-c2920778-b8ea-484c-b8c5-7ee68b4b4c26 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:14:31.670991 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-c2920778-b8ea-484c-b8c5-7ee68b4b4c26 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] [instance: 7b220b35-d9ac-48e4-b898-3d4f6c7be835] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:14:31.678922 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-c2920778-b8ea-484c-b8c5-7ee68b4b4c26 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:31.679424 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-c2920778-b8ea-484c-b8c5-7ee68b4b4c26 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:31.679864 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-c2920778-b8ea-484c-b8c5-7ee68b4b4c26 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:31.680862 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-c2920778-b8ea-484c-b8c5-7ee68b4b4c26 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:31.681322 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-c2920778-b8ea-484c-b8c5-7ee68b4b4c26 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:31.681752 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-c2920778-b8ea-484c-b8c5-7ee68b4b4c26 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:31.820882 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-c2920778-b8ea-484c-b8c5-7ee68b4b4c26 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce25db99a7b14d0bbaca41fff80e3da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5bad80dc0d74119b2a9cd5c1935e8d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:31.829250 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-c2920778-b8ea-484c-b8c5-7ee68b4b4c26 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] 10.222.0.27 "GET /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835" status: 200 len: 1715 microversion: 2.1 time: 0.163735 Oct 17 03:14:31.838966 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 232/434] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:14:31 2022] GET /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835 => generated 1715 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:14:31.839306 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-92eb28e1-4226-461b-8204-97a1bf2711c0 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c786544e8fb4e8e8c3a4990a0f36725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618cf0b3507845909bb27c13460d1d6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:31.839405 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-abd2df5e-7b6c-43d7-985f-405788053dd4 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:14:31.839405 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-abd2df5e-7b6c-43d7-985f-405788053dd4 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 603ee2bf-bedf-4688-ac0a-77a2a50f33d7] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:14:31.844535 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-92eb28e1-4226-461b-8204-97a1bf2711c0 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] 10.222.0.27 "GET /compute/v2.1/servers/d834c830-cb7f-43ce-ac79-2bf168e8f664" status: 200 len: 1368 microversion: 2.1 time: 0.295937 Oct 17 03:14:31.846724 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-abd2df5e-7b6c-43d7-985f-405788053dd4 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:31.847215 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 203/435] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:14:31 2022] GET /compute/v2.1/servers/d834c830-cb7f-43ce-ac79-2bf168e8f664 => generated 1368 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:14:31.852602 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-af91a3e1-bc7e-46e2-8bdd-37a95b8863cd tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:14:31.853025 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-abd2df5e-7b6c-43d7-985f-405788053dd4 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:31.853502 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-abd2df5e-7b6c-43d7-985f-405788053dd4 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:31.854230 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-abd2df5e-7b6c-43d7-985f-405788053dd4 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:31.854692 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-abd2df5e-7b6c-43d7-985f-405788053dd4 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:31.855143 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-abd2df5e-7b6c-43d7-985f-405788053dd4 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:31.859656 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-af91a3e1-bc7e-46e2-8bdd-37a95b8863cd tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: 712578d1-d2fb-4252-adbb-bc87096acc00] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:14:31.871778 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-af91a3e1-bc7e-46e2-8bdd-37a95b8863cd tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:31.872670 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-af91a3e1-bc7e-46e2-8bdd-37a95b8863cd tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:31.873114 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-af91a3e1-bc7e-46e2-8bdd-37a95b8863cd tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:31.873823 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-af91a3e1-bc7e-46e2-8bdd-37a95b8863cd tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:31.874278 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-af91a3e1-bc7e-46e2-8bdd-37a95b8863cd tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:31.875254 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-af91a3e1-bc7e-46e2-8bdd-37a95b8863cd tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:31.906147 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-abd2df5e-7b6c-43d7-985f-405788053dd4 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 603ee2bf-bedf-4688-ac0a-77a2a50f33d7] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=118886) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 17 03:14:32.006305 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-abd2df5e-7b6c-43d7-985f-405788053dd4 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "POST /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7/action" status: 202 len: 0 microversion: 2.20 time: 0.174136 Oct 17 03:14:32.011234 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 233/436] 10.222.0.27 () {62 vars in 1319 bytes} [Mon Oct 17 03:14:31 2022] POST /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7/action => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 17 03:14:32.019437 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [req-44786711-c4ca-48dd-a513-a0ac3a20e057 req-02f86007-6c06-4e24-a938-f5ecbbee730a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d834c830-cb7f-43ce-ac79-2bf168e8f664", "tag": "7589b628-e985-4bc3-a2e0-858b8f897a49"}]} {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:14:32.031262 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [req-44786711-c4ca-48dd-a513-a0ac3a20e057 req-02f86007-6c06-4e24-a938-f5ecbbee730a service nova] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:32.031925 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [req-44786711-c4ca-48dd-a513-a0ac3a20e057 req-02f86007-6c06-4e24-a938-f5ecbbee730a service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:32.032463 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [req-44786711-c4ca-48dd-a513-a0ac3a20e057 req-02f86007-6c06-4e24-a938-f5ecbbee730a service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:32.046813 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.compute.server_external_events [req-44786711-c4ca-48dd-a513-a0ac3a20e057 req-02f86007-6c06-4e24-a938-f5ecbbee730a service nova] Creating event network-changed:7589b628-e985-4bc3-a2e0-858b8f897a49 for instance d834c830-cb7f-43ce-ac79-2bf168e8f664 on hv-cinder-84697 Oct 17 03:14:32.052998 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [req-44786711-c4ca-48dd-a513-a0ac3a20e057 req-02f86007-6c06-4e24-a938-f5ecbbee730a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039706 Oct 17 03:14:32.054173 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 234/437] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 03:14:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:14:32.061224 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [req-03ecf92f-95d9-452b-9905-1649f414a892 req-4995c751-9939-4b4b-969d-e64811f9fd0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "603ee2bf-bedf-4688-ac0a-77a2a50f33d7", "name": "network-vif-unplugged", "status": "completed", "tag": "faf2315a-88ad-4367-997b-65c1cf0209ee"}]} {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:14:32.077407 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [req-03ecf92f-95d9-452b-9905-1649f414a892 req-4995c751-9939-4b4b-969d-e64811f9fd0f service nova] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:32.078278 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [req-03ecf92f-95d9-452b-9905-1649f414a892 req-4995c751-9939-4b4b-969d-e64811f9fd0f service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:32.078817 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [req-03ecf92f-95d9-452b-9905-1649f414a892 req-4995c751-9939-4b4b-969d-e64811f9fd0f service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:32.095966 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.compute.server_external_events [req-03ecf92f-95d9-452b-9905-1649f414a892 req-4995c751-9939-4b4b-969d-e64811f9fd0f service nova] Unable to find a host for instance 603ee2bf-bedf-4688-ac0a-77a2a50f33d7. Dropping event network-vif-unplugged {{(pid=118886) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 17 03:14:32.097453 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [req-03ecf92f-95d9-452b-9905-1649f414a892 req-4995c751-9939-4b4b-969d-e64811f9fd0f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.041479 Oct 17 03:14:32.099580 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 235/438] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 03:14:32 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 45 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 17 03:14:32.105809 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-09f44547-7177-4f22-bb8a-b796995dcfe9 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:14:32.107174 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-09f44547-7177-4f22-bb8a-b796995dcfe9 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 603ee2bf-bedf-4688-ac0a-77a2a50f33d7] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:14:32.113571 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-09f44547-7177-4f22-bb8a-b796995dcfe9 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:32.114062 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-09f44547-7177-4f22-bb8a-b796995dcfe9 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:32.115322 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-09f44547-7177-4f22-bb8a-b796995dcfe9 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:32.116139 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-09f44547-7177-4f22-bb8a-b796995dcfe9 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:32.116596 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-09f44547-7177-4f22-bb8a-b796995dcfe9 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:32.117075 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-09f44547-7177-4f22-bb8a-b796995dcfe9 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:32.275899 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-af91a3e1-bc7e-46e2-8bdd-37a95b8863cd tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1787a9ef7c44e28076aaa80c0152fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee21a91b84794e80b208fe72b7f1e010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:32.282262 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-09f44547-7177-4f22-bb8a-b796995dcfe9 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:32.299836 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-af91a3e1-bc7e-46e2-8bdd-37a95b8863cd tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "GET /compute/v2.1/servers/712578d1-d2fb-4252-adbb-bc87096acc00" status: 200 len: 1369 microversion: 2.1 time: 0.448759 Oct 17 03:14:32.301749 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 204/439] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:14:31 2022] GET /compute/v2.1/servers/712578d1-d2fb-4252-adbb-bc87096acc00 => generated 1369 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:14:32.303927 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-09f44547-7177-4f22-bb8a-b796995dcfe9 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:32.305629 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-09f44547-7177-4f22-bb8a-b796995dcfe9 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:32.307079 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-09f44547-7177-4f22-bb8a-b796995dcfe9 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7" status: 200 len: 1751 microversion: 2.20 time: 0.206408 Oct 17 03:14:32.319982 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 236/440] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 03:14:32 2022] GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7 => generated 1751 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:14:32.327516 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-e570617e-5cab-4c76-a794-a2d34bb0ab94 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:14:32.329214 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-e570617e-5cab-4c76-a794-a2d34bb0ab94 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] [instance: d7fc9f01-479b-43e9-9415-fe96b7140a47] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:14:32.339099 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-e570617e-5cab-4c76-a794-a2d34bb0ab94 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:32.341671 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-e570617e-5cab-4c76-a794-a2d34bb0ab94 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:32.342119 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-e570617e-5cab-4c76-a794-a2d34bb0ab94 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:32.343617 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-e570617e-5cab-4c76-a794-a2d34bb0ab94 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:32.344372 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-e570617e-5cab-4c76-a794-a2d34bb0ab94 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:32.345644 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-e570617e-5cab-4c76-a794-a2d34bb0ab94 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:32.535830 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.objects.instance [None req-e570617e-5cab-4c76-a794-a2d34bb0ab94 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Lazy-loading 'services' on Instance uuid d7fc9f01-479b-43e9-9415-fe96b7140a47 {{(pid=118887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 03:14:32.685909 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-e570617e-5cab-4c76-a794-a2d34bb0ab94 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] 10.222.0.27 "DELETE /compute/v2.1/servers/d7fc9f01-479b-43e9-9415-fe96b7140a47/os-volume_attachments/1b24c1f9-2b57-48f7-9451-6cd036f94b28" status: 202 len: 0 microversion: 2.1 time: 0.365048 Oct 17 03:14:32.690208 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 205/441] 10.222.0.27 () {58 vars in 1416 bytes} [Mon Oct 17 03:14:32 2022] DELETE /compute/v2.1/servers/d7fc9f01-479b-43e9-9415-fe96b7140a47/os-volume_attachments/1b24c1f9-2b57-48f7-9451-6cd036f94b28 => generated 0 bytes in 370 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 03:14:32.867911 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-b22ec722-846a-4216-8691-4437fde795dd tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:14:32.868581 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-b22ec722-846a-4216-8691-4437fde795dd tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] [instance: d834c830-cb7f-43ce-ac79-2bf168e8f664] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:14:32.875325 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-b22ec722-846a-4216-8691-4437fde795dd tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:32.875974 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-b22ec722-846a-4216-8691-4437fde795dd tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:32.876401 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-b22ec722-846a-4216-8691-4437fde795dd tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:32.877116 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-b22ec722-846a-4216-8691-4437fde795dd tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:32.877568 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-b22ec722-846a-4216-8691-4437fde795dd tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:32.877981 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-b22ec722-846a-4216-8691-4437fde795dd tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:33.048052 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-b22ec722-846a-4216-8691-4437fde795dd tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c786544e8fb4e8e8c3a4990a0f36725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618cf0b3507845909bb27c13460d1d6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:33.058022 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-b22ec722-846a-4216-8691-4437fde795dd tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] 10.222.0.27 "GET /compute/v2.1/servers/d834c830-cb7f-43ce-ac79-2bf168e8f664" status: 200 len: 1368 microversion: 2.1 time: 0.194657 Oct 17 03:14:33.058600 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 237/442] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:14:32 2022] GET /compute/v2.1/servers/d834c830-cb7f-43ce-ac79-2bf168e8f664 => generated 1368 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:14:33.331516 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-6041602b-cab7-4ecf-9f7b-3942b090b8e6 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:14:33.332267 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-6041602b-cab7-4ecf-9f7b-3942b090b8e6 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: 712578d1-d2fb-4252-adbb-bc87096acc00] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:14:33.333901 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-bad84ac6-ffae-44cb-849b-30563e7960d8 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:14:33.334510 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-bad84ac6-ffae-44cb-849b-30563e7960d8 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 603ee2bf-bedf-4688-ac0a-77a2a50f33d7] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:14:33.339651 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-6041602b-cab7-4ecf-9f7b-3942b090b8e6 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:33.340183 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-6041602b-cab7-4ecf-9f7b-3942b090b8e6 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:33.340338 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-bad84ac6-ffae-44cb-849b-30563e7960d8 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:33.340658 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-6041602b-cab7-4ecf-9f7b-3942b090b8e6 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:33.340816 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-bad84ac6-ffae-44cb-849b-30563e7960d8 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:33.341247 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-bad84ac6-ffae-44cb-849b-30563e7960d8 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:33.341396 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-6041602b-cab7-4ecf-9f7b-3942b090b8e6 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:33.341853 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-6041602b-cab7-4ecf-9f7b-3942b090b8e6 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:33.341952 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-bad84ac6-ffae-44cb-849b-30563e7960d8 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:33.342321 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-6041602b-cab7-4ecf-9f7b-3942b090b8e6 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:33.342418 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-bad84ac6-ffae-44cb-849b-30563e7960d8 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:33.342777 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-bad84ac6-ffae-44cb-849b-30563e7960d8 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:33.473152 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-bad84ac6-ffae-44cb-849b-30563e7960d8 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:33.473625 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-6041602b-cab7-4ecf-9f7b-3942b090b8e6 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1787a9ef7c44e28076aaa80c0152fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee21a91b84794e80b208fe72b7f1e010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:33.481766 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-6041602b-cab7-4ecf-9f7b-3942b090b8e6 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "GET /compute/v2.1/servers/712578d1-d2fb-4252-adbb-bc87096acc00" status: 200 len: 1369 microversion: 2.1 time: 0.154572 Oct 17 03:14:33.482246 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-bad84ac6-ffae-44cb-849b-30563e7960d8 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:33.483747 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-bad84ac6-ffae-44cb-849b-30563e7960d8 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:33.484905 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-bad84ac6-ffae-44cb-849b-30563e7960d8 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7" status: 200 len: 1751 microversion: 2.20 time: 0.155463 Oct 17 03:14:33.485455 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 238/443] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 03:14:33 2022] GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7 => generated 1751 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 03:14:33.489234 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 206/444] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:14:33 2022] GET /compute/v2.1/servers/712578d1-d2fb-4252-adbb-bc87096acc00 => generated 1369 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:14:34.082346 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-c2e3a2cf-78aa-4812-8ade-f9f2909ad9fd tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:14:34.083085 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-c2e3a2cf-78aa-4812-8ade-f9f2909ad9fd tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] [instance: d834c830-cb7f-43ce-ac79-2bf168e8f664] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:14:34.090086 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-c2e3a2cf-78aa-4812-8ade-f9f2909ad9fd tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:34.090937 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-c2e3a2cf-78aa-4812-8ade-f9f2909ad9fd tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:34.091629 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-c2e3a2cf-78aa-4812-8ade-f9f2909ad9fd tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:34.092420 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-c2e3a2cf-78aa-4812-8ade-f9f2909ad9fd tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:34.092858 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-c2e3a2cf-78aa-4812-8ade-f9f2909ad9fd tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:34.093279 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-c2e3a2cf-78aa-4812-8ade-f9f2909ad9fd tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:34.222354 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-c2e3a2cf-78aa-4812-8ade-f9f2909ad9fd tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c786544e8fb4e8e8c3a4990a0f36725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618cf0b3507845909bb27c13460d1d6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:34.230400 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-c2e3a2cf-78aa-4812-8ade-f9f2909ad9fd tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] 10.222.0.27 "GET /compute/v2.1/servers/d834c830-cb7f-43ce-ac79-2bf168e8f664" status: 200 len: 1368 microversion: 2.1 time: 0.152986 Oct 17 03:14:34.231033 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 239/445] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:14:34 2022] GET /compute/v2.1/servers/d834c830-cb7f-43ce-ac79-2bf168e8f664 => generated 1368 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:14:34.504330 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-ed3a5084-1e69-4dea-864c-8d4a2e62a971 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:14:34.504990 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-ed3a5084-1e69-4dea-864c-8d4a2e62a971 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: 712578d1-d2fb-4252-adbb-bc87096acc00] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:14:34.510336 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-115cfeda-636e-4dc9-b975-481bd487b083 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:14:34.510962 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-115cfeda-636e-4dc9-b975-481bd487b083 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 603ee2bf-bedf-4688-ac0a-77a2a50f33d7] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:14:34.511616 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-ed3a5084-1e69-4dea-864c-8d4a2e62a971 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:34.512099 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-ed3a5084-1e69-4dea-864c-8d4a2e62a971 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:34.512533 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-ed3a5084-1e69-4dea-864c-8d4a2e62a971 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:34.513223 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-ed3a5084-1e69-4dea-864c-8d4a2e62a971 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:34.513678 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-ed3a5084-1e69-4dea-864c-8d4a2e62a971 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:34.514098 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-ed3a5084-1e69-4dea-864c-8d4a2e62a971 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:34.517155 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-115cfeda-636e-4dc9-b975-481bd487b083 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:34.517636 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-115cfeda-636e-4dc9-b975-481bd487b083 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:34.518070 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-115cfeda-636e-4dc9-b975-481bd487b083 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:34.518760 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-115cfeda-636e-4dc9-b975-481bd487b083 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:34.519265 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-115cfeda-636e-4dc9-b975-481bd487b083 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:34.519688 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-115cfeda-636e-4dc9-b975-481bd487b083 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:34.649403 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-ed3a5084-1e69-4dea-864c-8d4a2e62a971 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1787a9ef7c44e28076aaa80c0152fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee21a91b84794e80b208fe72b7f1e010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:34.651635 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-115cfeda-636e-4dc9-b975-481bd487b083 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:34.657837 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-ed3a5084-1e69-4dea-864c-8d4a2e62a971 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "GET /compute/v2.1/servers/712578d1-d2fb-4252-adbb-bc87096acc00" status: 200 len: 1369 microversion: 2.1 time: 0.157421 Oct 17 03:14:34.658488 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 207/446] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:14:34 2022] GET /compute/v2.1/servers/712578d1-d2fb-4252-adbb-bc87096acc00 => generated 1369 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:14:34.660322 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-115cfeda-636e-4dc9-b975-481bd487b083 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:34.662528 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-115cfeda-636e-4dc9-b975-481bd487b083 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:34.663755 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-115cfeda-636e-4dc9-b975-481bd487b083 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7" status: 200 len: 1751 microversion: 2.20 time: 0.157199 Oct 17 03:14:34.664299 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 240/447] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 03:14:34 2022] GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7 => generated 1751 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 03:14:35.253451 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-59476e7b-1deb-4119-88d7-06a14f21cafa tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:14:35.254058 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-59476e7b-1deb-4119-88d7-06a14f21cafa tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] [instance: d834c830-cb7f-43ce-ac79-2bf168e8f664] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:14:35.260822 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-59476e7b-1deb-4119-88d7-06a14f21cafa tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:35.261296 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-59476e7b-1deb-4119-88d7-06a14f21cafa tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:35.261722 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-59476e7b-1deb-4119-88d7-06a14f21cafa tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:35.262397 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-59476e7b-1deb-4119-88d7-06a14f21cafa tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:35.262839 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-59476e7b-1deb-4119-88d7-06a14f21cafa tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:35.263275 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-59476e7b-1deb-4119-88d7-06a14f21cafa tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:35.393584 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-59476e7b-1deb-4119-88d7-06a14f21cafa tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c786544e8fb4e8e8c3a4990a0f36725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618cf0b3507845909bb27c13460d1d6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:35.401652 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-59476e7b-1deb-4119-88d7-06a14f21cafa tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] 10.222.0.27 "GET /compute/v2.1/servers/d834c830-cb7f-43ce-ac79-2bf168e8f664" status: 200 len: 1368 microversion: 2.1 time: 0.152011 Oct 17 03:14:35.402212 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 208/448] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:14:35 2022] GET /compute/v2.1/servers/d834c830-cb7f-43ce-ac79-2bf168e8f664 => generated 1368 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:14:35.681062 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-6dade815-6e92-409f-912e-1966ea19c80f tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:14:35.681661 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-6dade815-6e92-409f-912e-1966ea19c80f tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: 712578d1-d2fb-4252-adbb-bc87096acc00] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:14:35.685273 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG dbcounter [-] [118886] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=118886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:14:35.688640 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-9a527115-db9a-439a-8d37-da36fb4616f9 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:14:35.689254 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-9a527115-db9a-439a-8d37-da36fb4616f9 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 603ee2bf-bedf-4688-ac0a-77a2a50f33d7] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:14:35.689369 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-6dade815-6e92-409f-912e-1966ea19c80f tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:35.689733 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-6dade815-6e92-409f-912e-1966ea19c80f tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:35.690158 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-6dade815-6e92-409f-912e-1966ea19c80f tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:35.690839 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-6dade815-6e92-409f-912e-1966ea19c80f tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:35.691304 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-6dade815-6e92-409f-912e-1966ea19c80f tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:35.691720 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-6dade815-6e92-409f-912e-1966ea19c80f tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:35.696310 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-9a527115-db9a-439a-8d37-da36fb4616f9 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:35.696810 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-9a527115-db9a-439a-8d37-da36fb4616f9 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:35.697228 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-9a527115-db9a-439a-8d37-da36fb4616f9 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:35.697917 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-9a527115-db9a-439a-8d37-da36fb4616f9 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:35.698368 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-9a527115-db9a-439a-8d37-da36fb4616f9 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:35.698956 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-9a527115-db9a-439a-8d37-da36fb4616f9 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:35.823553 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-6dade815-6e92-409f-912e-1966ea19c80f tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1787a9ef7c44e28076aaa80c0152fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee21a91b84794e80b208fe72b7f1e010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:35.829796 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-9a527115-db9a-439a-8d37-da36fb4616f9 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:35.831245 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-6dade815-6e92-409f-912e-1966ea19c80f tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "GET /compute/v2.1/servers/712578d1-d2fb-4252-adbb-bc87096acc00" status: 200 len: 1369 microversion: 2.1 time: 0.154133 Oct 17 03:14:35.831915 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 241/449] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:14:35 2022] GET /compute/v2.1/servers/712578d1-d2fb-4252-adbb-bc87096acc00 => generated 1369 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:14:35.838656 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-9a527115-db9a-439a-8d37-da36fb4616f9 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:35.840144 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-9a527115-db9a-439a-8d37-da36fb4616f9 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:35.841295 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-9a527115-db9a-439a-8d37-da36fb4616f9 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7" status: 200 len: 1751 microversion: 2.20 time: 0.156551 Oct 17 03:14:35.841840 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 209/450] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 03:14:35 2022] GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7 => generated 1751 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 03:14:36.425393 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-19c5369b-aec2-4f44-a3d4-ccc70e70a1f9 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:14:36.426016 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-19c5369b-aec2-4f44-a3d4-ccc70e70a1f9 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] [instance: d834c830-cb7f-43ce-ac79-2bf168e8f664] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:14:36.432033 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-19c5369b-aec2-4f44-a3d4-ccc70e70a1f9 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:36.432507 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-19c5369b-aec2-4f44-a3d4-ccc70e70a1f9 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:36.432932 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-19c5369b-aec2-4f44-a3d4-ccc70e70a1f9 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:36.433609 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-19c5369b-aec2-4f44-a3d4-ccc70e70a1f9 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:36.434051 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-19c5369b-aec2-4f44-a3d4-ccc70e70a1f9 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:36.434463 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-19c5369b-aec2-4f44-a3d4-ccc70e70a1f9 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:36.562241 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-19c5369b-aec2-4f44-a3d4-ccc70e70a1f9 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c786544e8fb4e8e8c3a4990a0f36725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618cf0b3507845909bb27c13460d1d6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:36.570692 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-19c5369b-aec2-4f44-a3d4-ccc70e70a1f9 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] 10.222.0.27 "GET /compute/v2.1/servers/d834c830-cb7f-43ce-ac79-2bf168e8f664" status: 200 len: 1368 microversion: 2.1 time: 0.149090 Oct 17 03:14:36.571296 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 242/451] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:14:36 2022] GET /compute/v2.1/servers/d834c830-cb7f-43ce-ac79-2bf168e8f664 => generated 1368 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:14:36.853089 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-ce793f35-c20b-405e-a49d-79bad58dc0be tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:14:36.853623 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-ce793f35-c20b-405e-a49d-79bad58dc0be tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: 712578d1-d2fb-4252-adbb-bc87096acc00] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:14:36.860108 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-ce793f35-c20b-405e-a49d-79bad58dc0be tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:36.860587 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-ce793f35-c20b-405e-a49d-79bad58dc0be tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:36.861028 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-ce793f35-c20b-405e-a49d-79bad58dc0be tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:36.861721 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-ce793f35-c20b-405e-a49d-79bad58dc0be tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:36.862173 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-ce793f35-c20b-405e-a49d-79bad58dc0be tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:36.862599 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-ce793f35-c20b-405e-a49d-79bad58dc0be tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:36.867144 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-cc2876ef-cb4c-44c1-9082-c6063b33f7aa tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:14:36.867743 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-cc2876ef-cb4c-44c1-9082-c6063b33f7aa tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 603ee2bf-bedf-4688-ac0a-77a2a50f33d7] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:14:36.873974 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-cc2876ef-cb4c-44c1-9082-c6063b33f7aa tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:36.874448 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-cc2876ef-cb4c-44c1-9082-c6063b33f7aa tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:36.874896 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-cc2876ef-cb4c-44c1-9082-c6063b33f7aa tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:36.875590 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-cc2876ef-cb4c-44c1-9082-c6063b33f7aa tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:36.876033 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-cc2876ef-cb4c-44c1-9082-c6063b33f7aa tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:36.876450 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-cc2876ef-cb4c-44c1-9082-c6063b33f7aa tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:36.999925 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-ce793f35-c20b-405e-a49d-79bad58dc0be tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1787a9ef7c44e28076aaa80c0152fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee21a91b84794e80b208fe72b7f1e010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:37.010067 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-ce793f35-c20b-405e-a49d-79bad58dc0be tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "GET /compute/v2.1/servers/712578d1-d2fb-4252-adbb-bc87096acc00" status: 200 len: 1369 microversion: 2.1 time: 0.160826 Oct 17 03:14:37.010574 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-cc2876ef-cb4c-44c1-9082-c6063b33f7aa tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:37.019764 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-cc2876ef-cb4c-44c1-9082-c6063b33f7aa tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:37.021215 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-cc2876ef-cb4c-44c1-9082-c6063b33f7aa tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:37.022358 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-cc2876ef-cb4c-44c1-9082-c6063b33f7aa tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7" status: 200 len: 1751 microversion: 2.20 time: 0.159668 Oct 17 03:14:37.023061 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 243/452] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 03:14:36 2022] GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7 => generated 1751 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:14:37.026205 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 210/453] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:14:36 2022] GET /compute/v2.1/servers/712578d1-d2fb-4252-adbb-bc87096acc00 => generated 1369 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:14:37.593621 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-d73a008c-c174-4995-980c-8517bf0e32c0 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:14:37.594229 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-d73a008c-c174-4995-980c-8517bf0e32c0 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] [instance: d834c830-cb7f-43ce-ac79-2bf168e8f664] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:14:37.600207 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-d73a008c-c174-4995-980c-8517bf0e32c0 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:37.600690 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-d73a008c-c174-4995-980c-8517bf0e32c0 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:37.601120 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-d73a008c-c174-4995-980c-8517bf0e32c0 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:37.601880 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-d73a008c-c174-4995-980c-8517bf0e32c0 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:37.602676 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-d73a008c-c174-4995-980c-8517bf0e32c0 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:37.602809 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-d73a008c-c174-4995-980c-8517bf0e32c0 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:37.748493 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-d73a008c-c174-4995-980c-8517bf0e32c0 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c786544e8fb4e8e8c3a4990a0f36725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618cf0b3507845909bb27c13460d1d6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:37.752018 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG dbcounter [-] [118886] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=118886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:14:37.758995 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-d73a008c-c174-4995-980c-8517bf0e32c0 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] 10.222.0.27 "GET /compute/v2.1/servers/d834c830-cb7f-43ce-ac79-2bf168e8f664" status: 200 len: 1368 microversion: 2.1 time: 0.169219 Oct 17 03:14:37.759577 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 244/454] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:14:37 2022] GET /compute/v2.1/servers/d834c830-cb7f-43ce-ac79-2bf168e8f664 => generated 1368 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:14:38.034032 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-51050757-6531-4877-bc94-f7071597779f tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:14:38.034601 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-51050757-6531-4877-bc94-f7071597779f tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: 712578d1-d2fb-4252-adbb-bc87096acc00] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:14:38.045016 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-51050757-6531-4877-bc94-f7071597779f tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:38.045690 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-51050757-6531-4877-bc94-f7071597779f tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:38.046198 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-51050757-6531-4877-bc94-f7071597779f tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:38.047029 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-51050757-6531-4877-bc94-f7071597779f tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:38.047711 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-51050757-6531-4877-bc94-f7071597779f tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:38.047829 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-26e559a8-468b-46b2-8a45-cd4035e24c1f tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:14:38.048265 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-51050757-6531-4877-bc94-f7071597779f tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:38.048351 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-26e559a8-468b-46b2-8a45-cd4035e24c1f tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 603ee2bf-bedf-4688-ac0a-77a2a50f33d7] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:14:38.060094 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-26e559a8-468b-46b2-8a45-cd4035e24c1f tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:38.060586 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-26e559a8-468b-46b2-8a45-cd4035e24c1f tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:38.061017 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-26e559a8-468b-46b2-8a45-cd4035e24c1f tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:38.061772 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-26e559a8-468b-46b2-8a45-cd4035e24c1f tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:38.062235 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-26e559a8-468b-46b2-8a45-cd4035e24c1f tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:38.062662 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-26e559a8-468b-46b2-8a45-cd4035e24c1f tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:38.220356 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-26e559a8-468b-46b2-8a45-cd4035e24c1f tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:38.231418 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-26e559a8-468b-46b2-8a45-cd4035e24c1f tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:38.232970 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-26e559a8-468b-46b2-8a45-cd4035e24c1f tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:38.234176 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-26e559a8-468b-46b2-8a45-cd4035e24c1f tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7" status: 200 len: 1753 microversion: 2.20 time: 0.190245 Oct 17 03:14:38.235091 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-51050757-6531-4877-bc94-f7071597779f tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1787a9ef7c44e28076aaa80c0152fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee21a91b84794e80b208fe72b7f1e010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:38.235441 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 245/455] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 03:14:38 2022] GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7 => generated 1753 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 03:14:38.240756 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-8d464b91-aea8-4a4b-9368-492c0827b1d5 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:14:38.241520 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-8d464b91-aea8-4a4b-9368-492c0827b1d5 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] [instance: d7fc9f01-479b-43e9-9415-fe96b7140a47] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:14:38.246232 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-51050757-6531-4877-bc94-f7071597779f tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "GET /compute/v2.1/servers/712578d1-d2fb-4252-adbb-bc87096acc00" status: 200 len: 1369 microversion: 2.1 time: 0.216629 Oct 17 03:14:38.248373 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-8d464b91-aea8-4a4b-9368-492c0827b1d5 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:38.249033 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-8d464b91-aea8-4a4b-9368-492c0827b1d5 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:38.249156 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 211/456] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:14:38 2022] GET /compute/v2.1/servers/712578d1-d2fb-4252-adbb-bc87096acc00 => generated 1369 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:14:38.249866 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-8d464b91-aea8-4a4b-9368-492c0827b1d5 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:38.250800 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-8d464b91-aea8-4a4b-9368-492c0827b1d5 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:38.251443 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-8d464b91-aea8-4a4b-9368-492c0827b1d5 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:38.252011 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-8d464b91-aea8-4a4b-9368-492c0827b1d5 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:38.279509 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-8d464b91-aea8-4a4b-9368-492c0827b1d5 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] [instance: d7fc9f01-479b-43e9-9415-fe96b7140a47] Going to try to terminate instance {{(pid=118886) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 03:14:38.371282 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-8d464b91-aea8-4a4b-9368-492c0827b1d5 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] 10.222.0.27 "DELETE /compute/v2.1/servers/d7fc9f01-479b-43e9-9415-fe96b7140a47" status: 204 len: 0 microversion: 2.1 time: 0.134411 Oct 17 03:14:38.372419 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 246/457] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 03:14:38 2022] DELETE /compute/v2.1/servers/d7fc9f01-479b-43e9-9415-fe96b7140a47 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 03:14:38.381770 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-41677d2f-6779-4603-bbac-553d762ae4d5 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:14:38.382643 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-41677d2f-6779-4603-bbac-553d762ae4d5 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] [instance: d7fc9f01-479b-43e9-9415-fe96b7140a47] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:14:38.390387 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-41677d2f-6779-4603-bbac-553d762ae4d5 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:38.391181 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-41677d2f-6779-4603-bbac-553d762ae4d5 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:38.391821 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-41677d2f-6779-4603-bbac-553d762ae4d5 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:38.392615 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-41677d2f-6779-4603-bbac-553d762ae4d5 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:38.393353 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-41677d2f-6779-4603-bbac-553d762ae4d5 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:38.393898 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-41677d2f-6779-4603-bbac-553d762ae4d5 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:38.528747 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-41677d2f-6779-4603-bbac-553d762ae4d5 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc092c3cc0b4fbc9b420b8c7916132a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d285ecc0c5343b1b4001594013cd447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:38.536690 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-41677d2f-6779-4603-bbac-553d762ae4d5 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] 10.222.0.27 "GET /compute/v2.1/servers/d7fc9f01-479b-43e9-9415-fe96b7140a47" status: 200 len: 1514 microversion: 2.1 time: 0.159903 Oct 17 03:14:38.537333 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 212/458] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:14:38 2022] GET /compute/v2.1/servers/d7fc9f01-479b-43e9-9415-fe96b7140a47 => generated 1514 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:14:38.783049 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-b4e58359-dee6-4cb3-9bbe-31df030dd4ae tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:14:38.783876 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-b4e58359-dee6-4cb3-9bbe-31df030dd4ae tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] [instance: d834c830-cb7f-43ce-ac79-2bf168e8f664] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:14:38.791474 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-b4e58359-dee6-4cb3-9bbe-31df030dd4ae tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:38.792142 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-b4e58359-dee6-4cb3-9bbe-31df030dd4ae tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:38.792570 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-b4e58359-dee6-4cb3-9bbe-31df030dd4ae tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:38.793260 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-b4e58359-dee6-4cb3-9bbe-31df030dd4ae tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:38.793932 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-b4e58359-dee6-4cb3-9bbe-31df030dd4ae tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:38.794269 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-b4e58359-dee6-4cb3-9bbe-31df030dd4ae tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:38.925724 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-b4e58359-dee6-4cb3-9bbe-31df030dd4ae tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c786544e8fb4e8e8c3a4990a0f36725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618cf0b3507845909bb27c13460d1d6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:38.934089 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-b4e58359-dee6-4cb3-9bbe-31df030dd4ae tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] 10.222.0.27 "GET /compute/v2.1/servers/d834c830-cb7f-43ce-ac79-2bf168e8f664" status: 200 len: 1368 microversion: 2.1 time: 0.155602 Oct 17 03:14:38.934655 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 247/459] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:14:38 2022] GET /compute/v2.1/servers/d834c830-cb7f-43ce-ac79-2bf168e8f664 => generated 1368 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:14:39.265473 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-50e210e3-521b-4373-a5f1-9bec37aced79 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:14:39.266070 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-50e210e3-521b-4373-a5f1-9bec37aced79 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 603ee2bf-bedf-4688-ac0a-77a2a50f33d7] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:14:39.272500 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-50e210e3-521b-4373-a5f1-9bec37aced79 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:39.272970 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-50e210e3-521b-4373-a5f1-9bec37aced79 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:39.273398 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-50e210e3-521b-4373-a5f1-9bec37aced79 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:39.273985 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-e1deb416-5a0b-4f95-9315-5b46658a9c74 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:14:39.274381 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-50e210e3-521b-4373-a5f1-9bec37aced79 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:39.274517 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-50e210e3-521b-4373-a5f1-9bec37aced79 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:39.274745 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-e1deb416-5a0b-4f95-9315-5b46658a9c74 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: 712578d1-d2fb-4252-adbb-bc87096acc00] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:14:39.274957 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-50e210e3-521b-4373-a5f1-9bec37aced79 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:39.280796 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG dbcounter [-] [118887] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:14:39.282449 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-e1deb416-5a0b-4f95-9315-5b46658a9c74 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:39.283130 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-e1deb416-5a0b-4f95-9315-5b46658a9c74 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:39.283569 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-e1deb416-5a0b-4f95-9315-5b46658a9c74 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:39.284271 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-e1deb416-5a0b-4f95-9315-5b46658a9c74 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:39.284718 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-e1deb416-5a0b-4f95-9315-5b46658a9c74 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:39.285135 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-e1deb416-5a0b-4f95-9315-5b46658a9c74 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:39.409640 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-50e210e3-521b-4373-a5f1-9bec37aced79 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:39.418522 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-50e210e3-521b-4373-a5f1-9bec37aced79 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:39.420001 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-50e210e3-521b-4373-a5f1-9bec37aced79 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:39.421138 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-50e210e3-521b-4373-a5f1-9bec37aced79 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7" status: 200 len: 1753 microversion: 2.20 time: 0.159525 Oct 17 03:14:39.421702 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 213/460] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 03:14:39 2022] GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7 => generated 1753 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:14:39.424949 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-e1deb416-5a0b-4f95-9315-5b46658a9c74 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1787a9ef7c44e28076aaa80c0152fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee21a91b84794e80b208fe72b7f1e010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:39.433464 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-e1deb416-5a0b-4f95-9315-5b46658a9c74 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "GET /compute/v2.1/servers/712578d1-d2fb-4252-adbb-bc87096acc00" status: 200 len: 1369 microversion: 2.1 time: 0.163361 Oct 17 03:14:39.434188 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 248/461] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:14:39 2022] GET /compute/v2.1/servers/712578d1-d2fb-4252-adbb-bc87096acc00 => generated 1369 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:14:39.559991 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-86a5b482-42a9-455f-8e87-fe80a34ce3fb tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:14:39.560627 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-86a5b482-42a9-455f-8e87-fe80a34ce3fb tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] [instance: d7fc9f01-479b-43e9-9415-fe96b7140a47] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:14:39.566573 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-86a5b482-42a9-455f-8e87-fe80a34ce3fb tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:39.567099 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-86a5b482-42a9-455f-8e87-fe80a34ce3fb tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:39.567556 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-86a5b482-42a9-455f-8e87-fe80a34ce3fb tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:39.568340 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-86a5b482-42a9-455f-8e87-fe80a34ce3fb tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:39.568792 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-86a5b482-42a9-455f-8e87-fe80a34ce3fb tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:39.569215 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-86a5b482-42a9-455f-8e87-fe80a34ce3fb tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:39.698516 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-86a5b482-42a9-455f-8e87-fe80a34ce3fb tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc092c3cc0b4fbc9b420b8c7916132a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d285ecc0c5343b1b4001594013cd447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:39.706154 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-86a5b482-42a9-455f-8e87-fe80a34ce3fb tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] 10.222.0.27 "GET /compute/v2.1/servers/d7fc9f01-479b-43e9-9415-fe96b7140a47" status: 200 len: 1514 microversion: 2.1 time: 0.149977 Oct 17 03:14:39.706716 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 214/462] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:14:39 2022] GET /compute/v2.1/servers/d7fc9f01-479b-43e9-9415-fe96b7140a47 => generated 1514 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:14:39.962713 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-bd5b27c0-fd77-4130-9749-c9bd726423bb tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:14:39.963872 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-bd5b27c0-fd77-4130-9749-c9bd726423bb tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] [instance: d834c830-cb7f-43ce-ac79-2bf168e8f664] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:14:39.971526 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-bd5b27c0-fd77-4130-9749-c9bd726423bb tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:39.971946 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-bd5b27c0-fd77-4130-9749-c9bd726423bb tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:39.972531 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-bd5b27c0-fd77-4130-9749-c9bd726423bb tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:39.973450 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-bd5b27c0-fd77-4130-9749-c9bd726423bb tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:39.975720 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-bd5b27c0-fd77-4130-9749-c9bd726423bb tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:39.976023 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-bd5b27c0-fd77-4130-9749-c9bd726423bb tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:40.141236 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-bd5b27c0-fd77-4130-9749-c9bd726423bb tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c786544e8fb4e8e8c3a4990a0f36725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618cf0b3507845909bb27c13460d1d6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:40.149852 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-bd5b27c0-fd77-4130-9749-c9bd726423bb tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] 10.222.0.27 "GET /compute/v2.1/servers/d834c830-cb7f-43ce-ac79-2bf168e8f664" status: 200 len: 1368 microversion: 2.1 time: 0.196345 Oct 17 03:14:40.150428 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 249/463] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:14:39 2022] GET /compute/v2.1/servers/d834c830-cb7f-43ce-ac79-2bf168e8f664 => generated 1368 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:14:40.192183 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [req-0875b7e1-8c45-49fd-a810-763d94586fa1 req-e92dfcc2-d0b6-49fa-8bf3-3a49971caa41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d834c830-cb7f-43ce-ac79-2bf168e8f664", "name": "network-vif-plugged", "status": "completed", "tag": "7589b628-e985-4bc3-a2e0-858b8f897a49"}]} {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:14:40.210418 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [req-0875b7e1-8c45-49fd-a810-763d94586fa1 req-e92dfcc2-d0b6-49fa-8bf3-3a49971caa41 service nova] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:40.211368 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [req-0875b7e1-8c45-49fd-a810-763d94586fa1 req-e92dfcc2-d0b6-49fa-8bf3-3a49971caa41 service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:40.211860 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [req-0875b7e1-8c45-49fd-a810-763d94586fa1 req-e92dfcc2-d0b6-49fa-8bf3-3a49971caa41 service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:40.232888 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.compute.server_external_events [req-0875b7e1-8c45-49fd-a810-763d94586fa1 req-e92dfcc2-d0b6-49fa-8bf3-3a49971caa41 service nova] Creating event network-vif-plugged:7589b628-e985-4bc3-a2e0-858b8f897a49 for instance d834c830-cb7f-43ce-ac79-2bf168e8f664 on hv-cinder-84697 Oct 17 03:14:40.238578 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [req-0875b7e1-8c45-49fd-a810-763d94586fa1 req-e92dfcc2-d0b6-49fa-8bf3-3a49971caa41 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050822 Oct 17 03:14:40.239604 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 215/464] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 03:14:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:14:40.446966 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-32c97ad0-d8d9-4f42-9224-e44bd7b9a2b9 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:14:40.447608 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-32c97ad0-d8d9-4f42-9224-e44bd7b9a2b9 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 603ee2bf-bedf-4688-ac0a-77a2a50f33d7] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:14:40.454802 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-32c97ad0-d8d9-4f42-9224-e44bd7b9a2b9 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:40.455323 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-32c97ad0-d8d9-4f42-9224-e44bd7b9a2b9 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:40.455939 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-32c97ad0-d8d9-4f42-9224-e44bd7b9a2b9 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:40.456649 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-32c97ad0-d8d9-4f42-9224-e44bd7b9a2b9 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:40.457265 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-32c97ad0-d8d9-4f42-9224-e44bd7b9a2b9 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:40.457694 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-32c97ad0-d8d9-4f42-9224-e44bd7b9a2b9 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:40.459585 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-48d740c5-9637-4720-a141-fdfc957c5655 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:14:40.460292 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-48d740c5-9637-4720-a141-fdfc957c5655 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: 712578d1-d2fb-4252-adbb-bc87096acc00] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:14:40.467185 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-48d740c5-9637-4720-a141-fdfc957c5655 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:40.467593 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-48d740c5-9637-4720-a141-fdfc957c5655 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:40.468030 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-48d740c5-9637-4720-a141-fdfc957c5655 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:40.468735 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-48d740c5-9637-4720-a141-fdfc957c5655 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:40.469404 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-48d740c5-9637-4720-a141-fdfc957c5655 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:40.469836 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-48d740c5-9637-4720-a141-fdfc957c5655 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:40.607682 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-32c97ad0-d8d9-4f42-9224-e44bd7b9a2b9 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:40.617920 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-32c97ad0-d8d9-4f42-9224-e44bd7b9a2b9 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:40.619439 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-32c97ad0-d8d9-4f42-9224-e44bd7b9a2b9 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:40.621423 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-32c97ad0-d8d9-4f42-9224-e44bd7b9a2b9 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7" status: 200 len: 1809 microversion: 2.20 time: 0.178644 Oct 17 03:14:40.622028 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 250/465] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 03:14:40 2022] GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7 => generated 1809 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 03:14:40.729359 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-483ce3e2-7e05-46f7-ba51-cfe4fcfc7a46 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:14:40.730220 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-483ce3e2-7e05-46f7-ba51-cfe4fcfc7a46 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] [instance: d7fc9f01-479b-43e9-9415-fe96b7140a47] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:14:40.736205 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-483ce3e2-7e05-46f7-ba51-cfe4fcfc7a46 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:40.736689 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-483ce3e2-7e05-46f7-ba51-cfe4fcfc7a46 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:40.737120 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-483ce3e2-7e05-46f7-ba51-cfe4fcfc7a46 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:40.737818 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-483ce3e2-7e05-46f7-ba51-cfe4fcfc7a46 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:40.738269 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-483ce3e2-7e05-46f7-ba51-cfe4fcfc7a46 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:40.738695 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-483ce3e2-7e05-46f7-ba51-cfe4fcfc7a46 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:40.872229 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-483ce3e2-7e05-46f7-ba51-cfe4fcfc7a46 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc092c3cc0b4fbc9b420b8c7916132a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d285ecc0c5343b1b4001594013cd447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:40.880692 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-483ce3e2-7e05-46f7-ba51-cfe4fcfc7a46 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] 10.222.0.27 "GET /compute/v2.1/servers/d7fc9f01-479b-43e9-9415-fe96b7140a47" status: 200 len: 1514 microversion: 2.1 time: 0.154674 Oct 17 03:14:40.881628 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 251/466] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:14:40 2022] GET /compute/v2.1/servers/d7fc9f01-479b-43e9-9415-fe96b7140a47 => generated 1514 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:14:41.030620 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-48d740c5-9637-4720-a141-fdfc957c5655 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1787a9ef7c44e28076aaa80c0152fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee21a91b84794e80b208fe72b7f1e010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:41.039069 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-48d740c5-9637-4720-a141-fdfc957c5655 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "GET /compute/v2.1/servers/712578d1-d2fb-4252-adbb-bc87096acc00" status: 200 len: 1369 microversion: 2.1 time: 0.585123 Oct 17 03:14:41.039629 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 216/467] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:14:40 2022] GET /compute/v2.1/servers/712578d1-d2fb-4252-adbb-bc87096acc00 => generated 1369 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:14:41.183861 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-f2a785c5-62ee-4eaf-9d62-fb79fccc60e7 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:14:41.184536 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-f2a785c5-62ee-4eaf-9d62-fb79fccc60e7 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] [instance: d834c830-cb7f-43ce-ac79-2bf168e8f664] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:14:41.190580 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-f2a785c5-62ee-4eaf-9d62-fb79fccc60e7 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:41.191087 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-f2a785c5-62ee-4eaf-9d62-fb79fccc60e7 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:41.191511 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-f2a785c5-62ee-4eaf-9d62-fb79fccc60e7 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:41.192197 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-f2a785c5-62ee-4eaf-9d62-fb79fccc60e7 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:41.193337 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-f2a785c5-62ee-4eaf-9d62-fb79fccc60e7 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:41.193583 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-f2a785c5-62ee-4eaf-9d62-fb79fccc60e7 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:41.223128 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [req-96beaac7-de39-4e25-b881-c5946af2d2af req-a3c85850-2ea4-44e0-b726-30cd5d848ada service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7fc9f01-479b-43e9-9415-fe96b7140a47", "name": "network-vif-deleted", "tag": "366b0256-e4ee-408c-ae36-453ce05d015d"}]} {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:14:41.244035 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [req-96beaac7-de39-4e25-b881-c5946af2d2af req-a3c85850-2ea4-44e0-b726-30cd5d848ada service nova] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:41.244769 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [req-96beaac7-de39-4e25-b881-c5946af2d2af req-a3c85850-2ea4-44e0-b726-30cd5d848ada service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:41.246014 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [req-96beaac7-de39-4e25-b881-c5946af2d2af req-a3c85850-2ea4-44e0-b726-30cd5d848ada service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:41.261726 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.compute.server_external_events [req-96beaac7-de39-4e25-b881-c5946af2d2af req-a3c85850-2ea4-44e0-b726-30cd5d848ada service nova] Creating event network-vif-deleted:366b0256-e4ee-408c-ae36-453ce05d015d for instance d7fc9f01-479b-43e9-9415-fe96b7140a47 on hv-cinder-84697 Oct 17 03:14:41.270279 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [req-96beaac7-de39-4e25-b881-c5946af2d2af req-a3c85850-2ea4-44e0-b726-30cd5d848ada service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054902 Oct 17 03:14:41.271508 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 217/468] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 03:14:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 03:14:41.351578 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-f2a785c5-62ee-4eaf-9d62-fb79fccc60e7 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c786544e8fb4e8e8c3a4990a0f36725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618cf0b3507845909bb27c13460d1d6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:41.360025 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-f2a785c5-62ee-4eaf-9d62-fb79fccc60e7 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] 10.222.0.27 "GET /compute/v2.1/servers/d834c830-cb7f-43ce-ac79-2bf168e8f664" status: 200 len: 1368 microversion: 2.1 time: 0.180484 Oct 17 03:14:41.360637 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 252/469] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:14:41 2022] GET /compute/v2.1/servers/d834c830-cb7f-43ce-ac79-2bf168e8f664 => generated 1368 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:14:41.649269 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-01b68a86-896f-4ad9-b863-57568c3db58c tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:14:41.649901 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-01b68a86-896f-4ad9-b863-57568c3db58c tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 603ee2bf-bedf-4688-ac0a-77a2a50f33d7] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:14:41.656324 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-01b68a86-896f-4ad9-b863-57568c3db58c tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:41.656799 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-01b68a86-896f-4ad9-b863-57568c3db58c tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:41.657232 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-01b68a86-896f-4ad9-b863-57568c3db58c tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:41.657912 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-01b68a86-896f-4ad9-b863-57568c3db58c tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:41.658362 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-01b68a86-896f-4ad9-b863-57568c3db58c tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:41.658779 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-01b68a86-896f-4ad9-b863-57568c3db58c tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:41.790025 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-01b68a86-896f-4ad9-b863-57568c3db58c tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:41.798477 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-01b68a86-896f-4ad9-b863-57568c3db58c tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:41.800024 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-01b68a86-896f-4ad9-b863-57568c3db58c tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:41.801154 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-01b68a86-896f-4ad9-b863-57568c3db58c tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7" status: 200 len: 1809 microversion: 2.20 time: 0.157078 Oct 17 03:14:41.801715 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 218/470] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 03:14:41 2022] GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7 => generated 1809 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:14:41.905531 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-88ec1b26-a291-422b-9484-0ee0dd1f1be3 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:14:41.906142 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-88ec1b26-a291-422b-9484-0ee0dd1f1be3 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] [instance: d7fc9f01-479b-43e9-9415-fe96b7140a47] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:14:41.914820 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-88ec1b26-a291-422b-9484-0ee0dd1f1be3 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:41.915361 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-88ec1b26-a291-422b-9484-0ee0dd1f1be3 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:41.915799 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-88ec1b26-a291-422b-9484-0ee0dd1f1be3 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:41.916508 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-88ec1b26-a291-422b-9484-0ee0dd1f1be3 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:41.916965 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-88ec1b26-a291-422b-9484-0ee0dd1f1be3 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:41.917390 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-88ec1b26-a291-422b-9484-0ee0dd1f1be3 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:41.954262 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-88ec1b26-a291-422b-9484-0ee0dd1f1be3 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:41.954743 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-88ec1b26-a291-422b-9484-0ee0dd1f1be3 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:41.955221 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-88ec1b26-a291-422b-9484-0ee0dd1f1be3 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:41.955665 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.objects.instance [None req-88ec1b26-a291-422b-9484-0ee0dd1f1be3 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Lazy-loading 'fault' on Instance uuid d7fc9f01-479b-43e9-9415-fe96b7140a47 {{(pid=118886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 03:14:42.007586 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-88ec1b26-a291-422b-9484-0ee0dd1f1be3 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc092c3cc0b4fbc9b420b8c7916132a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d285ecc0c5343b1b4001594013cd447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:42.015823 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-88ec1b26-a291-422b-9484-0ee0dd1f1be3 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] 10.222.0.27 "GET /compute/v2.1/servers/d7fc9f01-479b-43e9-9415-fe96b7140a47" status: 200 len: 1309 microversion: 2.1 time: 0.115599 Oct 17 03:14:42.016521 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 253/471] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:14:41 2022] GET /compute/v2.1/servers/d7fc9f01-479b-43e9-9415-fe96b7140a47 => generated 1309 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:14:42.066091 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-e15a589b-47a6-41f5-a911-d8e8e22cedc0 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:14:42.066974 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-e15a589b-47a6-41f5-a911-d8e8e22cedc0 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: 712578d1-d2fb-4252-adbb-bc87096acc00] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:14:42.076803 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-e15a589b-47a6-41f5-a911-d8e8e22cedc0 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:42.077509 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-e15a589b-47a6-41f5-a911-d8e8e22cedc0 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:42.078064 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-e15a589b-47a6-41f5-a911-d8e8e22cedc0 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:42.079242 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-e15a589b-47a6-41f5-a911-d8e8e22cedc0 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:42.080433 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-e15a589b-47a6-41f5-a911-d8e8e22cedc0 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:42.081454 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-e15a589b-47a6-41f5-a911-d8e8e22cedc0 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:42.244690 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-e15a589b-47a6-41f5-a911-d8e8e22cedc0 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1787a9ef7c44e28076aaa80c0152fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee21a91b84794e80b208fe72b7f1e010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:42.252815 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-e15a589b-47a6-41f5-a911-d8e8e22cedc0 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "GET /compute/v2.1/servers/712578d1-d2fb-4252-adbb-bc87096acc00" status: 200 len: 1369 microversion: 2.1 time: 0.193143 Oct 17 03:14:42.253977 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 219/472] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:14:42 2022] GET /compute/v2.1/servers/712578d1-d2fb-4252-adbb-bc87096acc00 => generated 1369 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:14:42.266352 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [req-79dc0562-6aa6-41a3-b6ec-51f114fe84d9 req-9642274d-867e-4d3b-a5c6-abba318fc0cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "712578d1-d2fb-4252-adbb-bc87096acc00", "name": "network-vif-plugged", "status": "completed", "tag": "f7a1e8a6-f7aa-40af-a627-0640f636cc4a"}]} {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:14:42.276265 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [req-79dc0562-6aa6-41a3-b6ec-51f114fe84d9 req-9642274d-867e-4d3b-a5c6-abba318fc0cc service nova] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:42.277022 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [req-79dc0562-6aa6-41a3-b6ec-51f114fe84d9 req-9642274d-867e-4d3b-a5c6-abba318fc0cc service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:42.277524 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [req-79dc0562-6aa6-41a3-b6ec-51f114fe84d9 req-9642274d-867e-4d3b-a5c6-abba318fc0cc service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:42.290084 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.compute.server_external_events [req-79dc0562-6aa6-41a3-b6ec-51f114fe84d9 req-9642274d-867e-4d3b-a5c6-abba318fc0cc service nova] Creating event network-vif-plugged:f7a1e8a6-f7aa-40af-a627-0640f636cc4a for instance 712578d1-d2fb-4252-adbb-bc87096acc00 on hv-cinder-84697 Oct 17 03:14:42.295716 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [req-79dc0562-6aa6-41a3-b6ec-51f114fe84d9 req-9642274d-867e-4d3b-a5c6-abba318fc0cc service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032991 Oct 17 03:14:42.296449 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 254/473] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 03:14:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:14:42.389685 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-50016ced-dedb-4c31-96a8-451f15134738 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:14:42.390397 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-50016ced-dedb-4c31-96a8-451f15134738 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] [instance: d834c830-cb7f-43ce-ac79-2bf168e8f664] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:14:42.397432 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-50016ced-dedb-4c31-96a8-451f15134738 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:42.398475 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-50016ced-dedb-4c31-96a8-451f15134738 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:42.399314 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-50016ced-dedb-4c31-96a8-451f15134738 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:42.401590 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-50016ced-dedb-4c31-96a8-451f15134738 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:42.403346 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-50016ced-dedb-4c31-96a8-451f15134738 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:42.403795 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-50016ced-dedb-4c31-96a8-451f15134738 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:42.561353 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-50016ced-dedb-4c31-96a8-451f15134738 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c786544e8fb4e8e8c3a4990a0f36725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618cf0b3507845909bb27c13460d1d6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:42.575778 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-50016ced-dedb-4c31-96a8-451f15134738 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] 10.222.0.27 "GET /compute/v2.1/servers/d834c830-cb7f-43ce-ac79-2bf168e8f664" status: 200 len: 1368 microversion: 2.1 time: 0.194316 Oct 17 03:14:42.576587 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 220/474] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:14:42 2022] GET /compute/v2.1/servers/d834c830-cb7f-43ce-ac79-2bf168e8f664 => generated 1368 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:14:42.827821 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-77ec2cb8-2cc9-4779-9bba-09aa6804c3da tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:14:42.828524 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-77ec2cb8-2cc9-4779-9bba-09aa6804c3da tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 603ee2bf-bedf-4688-ac0a-77a2a50f33d7] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:14:42.835507 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-77ec2cb8-2cc9-4779-9bba-09aa6804c3da tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:42.835992 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-77ec2cb8-2cc9-4779-9bba-09aa6804c3da tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:42.836432 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-77ec2cb8-2cc9-4779-9bba-09aa6804c3da tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:42.837774 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-77ec2cb8-2cc9-4779-9bba-09aa6804c3da tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:42.838235 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-77ec2cb8-2cc9-4779-9bba-09aa6804c3da tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:42.838663 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-77ec2cb8-2cc9-4779-9bba-09aa6804c3da tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:42.970257 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-77ec2cb8-2cc9-4779-9bba-09aa6804c3da tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:42.979997 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-77ec2cb8-2cc9-4779-9bba-09aa6804c3da tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:42.981436 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-77ec2cb8-2cc9-4779-9bba-09aa6804c3da tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:42.982583 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-77ec2cb8-2cc9-4779-9bba-09aa6804c3da tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7" status: 200 len: 1809 microversion: 2.20 time: 0.159426 Oct 17 03:14:42.983163 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 255/475] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 03:14:42 2022] GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7 => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:14:43.041216 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-4d389d24-2fdf-4a7e-acdc-52c3ab73faca tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:14:43.041919 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-4d389d24-2fdf-4a7e-acdc-52c3ab73faca tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] [instance: d7fc9f01-479b-43e9-9415-fe96b7140a47] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:14:43.048314 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-4d389d24-2fdf-4a7e-acdc-52c3ab73faca tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:43.048804 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-4d389d24-2fdf-4a7e-acdc-52c3ab73faca tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:43.049242 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-4d389d24-2fdf-4a7e-acdc-52c3ab73faca tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:43.049940 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-4d389d24-2fdf-4a7e-acdc-52c3ab73faca tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:43.050393 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-4d389d24-2fdf-4a7e-acdc-52c3ab73faca tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:43.050816 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-4d389d24-2fdf-4a7e-acdc-52c3ab73faca tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:43.079267 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG dbcounter [-] [118887] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=118887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:14:43.085680 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-4d389d24-2fdf-4a7e-acdc-52c3ab73faca tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:43.086171 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-4d389d24-2fdf-4a7e-acdc-52c3ab73faca tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:43.086606 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-4d389d24-2fdf-4a7e-acdc-52c3ab73faca tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:43.087101 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.objects.instance [None req-4d389d24-2fdf-4a7e-acdc-52c3ab73faca tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Lazy-loading 'fault' on Instance uuid d7fc9f01-479b-43e9-9415-fe96b7140a47 {{(pid=118887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 03:14:43.145333 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-4d389d24-2fdf-4a7e-acdc-52c3ab73faca tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc092c3cc0b4fbc9b420b8c7916132a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d285ecc0c5343b1b4001594013cd447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:43.156450 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-4d389d24-2fdf-4a7e-acdc-52c3ab73faca tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] 10.222.0.27 "GET /compute/v2.1/servers/d7fc9f01-479b-43e9-9415-fe96b7140a47" status: 200 len: 1309 microversion: 2.1 time: 0.119990 Oct 17 03:14:43.157275 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 221/476] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:14:43 2022] GET /compute/v2.1/servers/d7fc9f01-479b-43e9-9415-fe96b7140a47 => generated 1309 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:14:43.277517 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-efe6b7f6-f1b1-4daf-8de7-cb8558e55ae8 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:14:43.278136 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-efe6b7f6-f1b1-4daf-8de7-cb8558e55ae8 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: 712578d1-d2fb-4252-adbb-bc87096acc00] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:14:43.284762 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-efe6b7f6-f1b1-4daf-8de7-cb8558e55ae8 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:43.285431 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-efe6b7f6-f1b1-4daf-8de7-cb8558e55ae8 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:43.286142 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-efe6b7f6-f1b1-4daf-8de7-cb8558e55ae8 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:43.287434 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-efe6b7f6-f1b1-4daf-8de7-cb8558e55ae8 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:43.288129 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-efe6b7f6-f1b1-4daf-8de7-cb8558e55ae8 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:43.288997 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-efe6b7f6-f1b1-4daf-8de7-cb8558e55ae8 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:43.448902 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-efe6b7f6-f1b1-4daf-8de7-cb8558e55ae8 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1787a9ef7c44e28076aaa80c0152fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee21a91b84794e80b208fe72b7f1e010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:43.456944 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-efe6b7f6-f1b1-4daf-8de7-cb8558e55ae8 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "GET /compute/v2.1/servers/712578d1-d2fb-4252-adbb-bc87096acc00" status: 200 len: 1369 microversion: 2.1 time: 0.183656 Oct 17 03:14:43.457856 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 256/477] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:14:43 2022] GET /compute/v2.1/servers/712578d1-d2fb-4252-adbb-bc87096acc00 => generated 1369 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:14:43.600480 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-030fdd1b-a2b1-4869-96f9-64219d9503ca tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:14:43.601421 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-030fdd1b-a2b1-4869-96f9-64219d9503ca tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] [instance: d834c830-cb7f-43ce-ac79-2bf168e8f664] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:14:43.610281 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-030fdd1b-a2b1-4869-96f9-64219d9503ca tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:43.617325 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-030fdd1b-a2b1-4869-96f9-64219d9503ca tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:43.617978 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-030fdd1b-a2b1-4869-96f9-64219d9503ca tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:43.618934 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-030fdd1b-a2b1-4869-96f9-64219d9503ca tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:43.619560 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-030fdd1b-a2b1-4869-96f9-64219d9503ca tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:43.620148 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-030fdd1b-a2b1-4869-96f9-64219d9503ca tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:43.837993 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-030fdd1b-a2b1-4869-96f9-64219d9503ca tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c786544e8fb4e8e8c3a4990a0f36725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618cf0b3507845909bb27c13460d1d6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:43.859611 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-030fdd1b-a2b1-4869-96f9-64219d9503ca tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] 10.222.0.27 "GET /compute/v2.1/servers/d834c830-cb7f-43ce-ac79-2bf168e8f664" status: 200 len: 1558 microversion: 2.1 time: 0.261920 Oct 17 03:14:43.861185 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 222/478] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:14:43 2022] GET /compute/v2.1/servers/d834c830-cb7f-43ce-ac79-2bf168e8f664 => generated 1558 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:14:43.883772 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-097507cc-8377-4881-a6c2-68594dfe5081 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:14:43.884295 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-097507cc-8377-4881-a6c2-68594dfe5081 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] [instance: d834c830-cb7f-43ce-ac79-2bf168e8f664] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:14:43.890438 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-097507cc-8377-4881-a6c2-68594dfe5081 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:43.891002 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-097507cc-8377-4881-a6c2-68594dfe5081 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:43.891452 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-097507cc-8377-4881-a6c2-68594dfe5081 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:43.892214 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-097507cc-8377-4881-a6c2-68594dfe5081 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:43.892687 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-097507cc-8377-4881-a6c2-68594dfe5081 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:43.893122 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-097507cc-8377-4881-a6c2-68594dfe5081 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:43.992816 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-097507cc-8377-4881-a6c2-68594dfe5081 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] 10.222.0.27 "GET /compute/v2.1/servers/d834c830-cb7f-43ce-ac79-2bf168e8f664/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.114007 Oct 17 03:14:43.994060 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 257/479] 10.222.0.27 () {58 vars in 1275 bytes} [Mon Oct 17 03:14:43 2022] GET /compute/v2.1/servers/d834c830-cb7f-43ce-ac79-2bf168e8f664/os-interface => generated 284 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:14:44.009594 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-0f98db05-775a-40fd-a823-5da95ee77133 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:14:44.010208 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-0f98db05-775a-40fd-a823-5da95ee77133 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 603ee2bf-bedf-4688-ac0a-77a2a50f33d7] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:14:44.019211 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-0f98db05-775a-40fd-a823-5da95ee77133 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:44.019702 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-0f98db05-775a-40fd-a823-5da95ee77133 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:44.020197 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-0f98db05-775a-40fd-a823-5da95ee77133 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:44.021585 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-0f98db05-775a-40fd-a823-5da95ee77133 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:44.022052 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-0f98db05-775a-40fd-a823-5da95ee77133 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:44.022481 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-0f98db05-775a-40fd-a823-5da95ee77133 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:44.166888 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-0f98db05-775a-40fd-a823-5da95ee77133 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:44.180964 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-ed5dc0dd-aa99-4fa8-b507-084396c27afe tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:14:44.181574 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-ed5dc0dd-aa99-4fa8-b507-084396c27afe tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] [instance: d7fc9f01-479b-43e9-9415-fe96b7140a47] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:14:44.186076 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-0f98db05-775a-40fd-a823-5da95ee77133 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:44.187989 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-ed5dc0dd-aa99-4fa8-b507-084396c27afe tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:44.188510 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-0f98db05-775a-40fd-a823-5da95ee77133 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:44.188863 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-ed5dc0dd-aa99-4fa8-b507-084396c27afe tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:44.189489 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-ed5dc0dd-aa99-4fa8-b507-084396c27afe tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:44.189709 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-0f98db05-775a-40fd-a823-5da95ee77133 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7" status: 200 len: 1809 microversion: 2.20 time: 0.184855 Oct 17 03:14:44.190267 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 223/480] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 03:14:44 2022] GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7 => generated 1809 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:14:44.211924 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-ed5dc0dd-aa99-4fa8-b507-084396c27afe tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:44.211924 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-ed5dc0dd-aa99-4fa8-b507-084396c27afe tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:44.211924 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-ed5dc0dd-aa99-4fa8-b507-084396c27afe tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:44.231348 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.wsgi [None req-ed5dc0dd-aa99-4fa8-b507-084396c27afe tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] HTTP exception thrown: Instance d7fc9f01-479b-43e9-9415-fe96b7140a47 could not be found. Oct 17 03:14:44.233033 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-ed5dc0dd-aa99-4fa8-b507-084396c27afe tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Request method failure captured: Oct 17 03:14:44.233033 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: request: GET /compute/v2.1/servers/d7fc9f01-479b-43e9-9415-fe96b7140a47 HTTP/1.1 Oct 17 03:14:44.233033 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Accept: application/json Oct 17 03:14:44.233033 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Accept-Encoding: identity Oct 17 03:14:44.233033 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Connection: close Oct 17 03:14:44.233033 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Content-Length: 0 Oct 17 03:14:44.233033 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Content-Type: application/json Oct 17 03:14:44.233033 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Host: 10.222.0.27 Oct 17 03:14:44.233033 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Openstack-System-Scope: None Oct 17 03:14:44.233033 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: User-Agent: python-urllib3/1.26.12 Oct 17 03:14:44.233033 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Auth-Token: gAAAAABjTMhEZSiNTo_1ODQwOUrYBQy-KNcLRd_m9WBoIhpr85k9UouBEhcUK_evVTDxTIunAVCU3uzMarzuNyjzEp94twr1Jnpfv5gc8nnmQkiwNJVFmP8zsdj_UWfD2WNN0Vdfyo8miyYMpFkxumfWUV6ErJ_EYgQG9jfI8yn-HaeE_nevY6U Oct 17 03:14:44.233033 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Domain-Id: None Oct 17 03:14:44.233033 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Domain-Name: None Oct 17 03:14:44.233033 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Identity-Status: Confirmed Oct 17 03:14:44.233033 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Is-Admin-Project: True Oct 17 03:14:44.233033 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Project-Domain-Id: default Oct 17 03:14:44.233033 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Project-Domain-Name: Default Oct 17 03:14:44.233033 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Project-Id: 0d285ecc0c5343b1b4001594013cd447 Oct 17 03:14:44.233033 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1412287430 Oct 17 03:14:44.233033 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Role: member,reader Oct 17 03:14:44.233033 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Roles: member,reader Oct 17 03:14:44.234518 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0d285ecc0c5343b1b4001594013cd447"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0d285ecc0c5343b1b4001594013cd447"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0d285ecc0c5343b1b4001594013cd447"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0d285ecc0c5343b1b4001594013cd447"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 17 03:14:44.234518 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Tenant: tempest-VolumesSnapshotTestJSON-1412287430 Oct 17 03:14:44.234518 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Tenant-Id: 0d285ecc0c5343b1b4001594013cd447 Oct 17 03:14:44.234518 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1412287430 Oct 17 03:14:44.234518 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-User: tempest-VolumesSnapshotTestJSON-1412287430-project Oct 17 03:14:44.234518 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-User-Domain-Id: default Oct 17 03:14:44.234518 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-User-Domain-Name: Default Oct 17 03:14:44.234518 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-User-Id: 7cc092c3cc0b4fbc9b420b8c7916132a Oct 17 03:14:44.234518 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-User-Name: tempest-VolumesSnapshotTestJSON-1412287430-project Oct 17 03:14:44.234518 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: method: > Oct 17 03:14:44.234518 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: exception: Instance d7fc9f01-479b-43e9-9415-fe96b7140a47 could not be found. Oct 17 03:14:44.234518 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: action_args: {'id': 'd7fc9f01-479b-43e9-9415-fe96b7140a47'} Oct 17 03:14:44.235433 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 03:14:44.235433 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:14:44.235433 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 03:14:44.235433 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 03:14:44.235433 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 03:14:44.235433 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 03:14:44.235433 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 03:14:44.235433 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 03:14:44.235433 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 03:14:44.235433 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 03:14:44.235433 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7fc9f01-479b-43e9-9415-fe96b7140a47 could not be found. Oct 17 03:14:44.235433 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Oct 17 03:14:44.235433 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:14:44.235433 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Oct 17 03:14:44.235433 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:14:44.235433 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:14:44.235433 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:14:44.235433 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 03:14:44.235433 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 03:14:44.235433 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 03:14:44.236999 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 03:14:44.236999 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 03:14:44.236999 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 03:14:44.236999 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 03:14:44.236999 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 03:14:44.236999 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 03:14:44.236999 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 03:14:44.236999 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7fc9f01-479b-43e9-9415-fe96b7140a47 could not be found. Oct 17 03:14:44.236999 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Oct 17 03:14:44.236999 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:14:44.236999 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Oct 17 03:14:44.236999 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:14:44.236999 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:14:44.236999 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:14:44.236999 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 03:14:44.236999 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 03:14:44.236999 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7fc9f01-479b-43e9-9415-fe96b7140a47 could not be found. Oct 17 03:14:44.236999 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Oct 17 03:14:44.238252 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-ed5dc0dd-aa99-4fa8-b507-084396c27afe tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Returning 404 to user: Instance d7fc9f01-479b-43e9-9415-fe96b7140a47 could not be found. {{(pid=118886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 03:14:44.238252 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-ed5dc0dd-aa99-4fa8-b507-084396c27afe tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] 10.222.0.27 "GET /compute/v2.1/servers/d7fc9f01-479b-43e9-9415-fe96b7140a47" status: 404 len: 111 microversion: 2.1 time: 0.057960 Oct 17 03:14:44.238252 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 258/481] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:14:44 2022] GET /compute/v2.1/servers/d7fc9f01-479b-43e9-9415-fe96b7140a47 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 03:14:44.483608 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-4f43f55e-e9aa-4fcd-9fec-659d70e4d300 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:14:44.484748 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-4f43f55e-e9aa-4fcd-9fec-659d70e4d300 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: 712578d1-d2fb-4252-adbb-bc87096acc00] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:14:44.494029 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-4f43f55e-e9aa-4fcd-9fec-659d70e4d300 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:44.495320 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-4f43f55e-e9aa-4fcd-9fec-659d70e4d300 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:44.495926 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-4f43f55e-e9aa-4fcd-9fec-659d70e4d300 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:44.496902 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-4f43f55e-e9aa-4fcd-9fec-659d70e4d300 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:44.497841 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-4f43f55e-e9aa-4fcd-9fec-659d70e4d300 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:44.498767 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-4f43f55e-e9aa-4fcd-9fec-659d70e4d300 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:44.711619 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-4f43f55e-e9aa-4fcd-9fec-659d70e4d300 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1787a9ef7c44e28076aaa80c0152fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee21a91b84794e80b208fe72b7f1e010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:44.721110 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-4f43f55e-e9aa-4fcd-9fec-659d70e4d300 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "GET /compute/v2.1/servers/712578d1-d2fb-4252-adbb-bc87096acc00" status: 200 len: 1369 microversion: 2.1 time: 0.242268 Oct 17 03:14:44.721623 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 224/482] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:14:44 2022] GET /compute/v2.1/servers/712578d1-d2fb-4252-adbb-bc87096acc00 => generated 1369 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:14:45.224196 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-af29fe25-4ec4-4900-986a-35d7f74195a8 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:14:45.225347 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-af29fe25-4ec4-4900-986a-35d7f74195a8 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 603ee2bf-bedf-4688-ac0a-77a2a50f33d7] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:14:45.235227 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [req-24b8f057-3aa4-4436-945a-2af4f482fd80 req-4f29c62c-cd63-4501-84c9-a26bc504eccd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d834c830-cb7f-43ce-ac79-2bf168e8f664", "tag": "7589b628-e985-4bc3-a2e0-858b8f897a49"}]} {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:14:45.243021 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-af29fe25-4ec4-4900-986a-35d7f74195a8 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:45.243513 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-af29fe25-4ec4-4900-986a-35d7f74195a8 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:45.243954 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-af29fe25-4ec4-4900-986a-35d7f74195a8 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:45.244671 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-af29fe25-4ec4-4900-986a-35d7f74195a8 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:45.245258 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-af29fe25-4ec4-4900-986a-35d7f74195a8 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:45.245700 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-af29fe25-4ec4-4900-986a-35d7f74195a8 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:45.247560 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [req-24b8f057-3aa4-4436-945a-2af4f482fd80 req-4f29c62c-cd63-4501-84c9-a26bc504eccd service nova] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:45.248274 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [req-24b8f057-3aa4-4436-945a-2af4f482fd80 req-4f29c62c-cd63-4501-84c9-a26bc504eccd service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:45.248918 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [req-24b8f057-3aa4-4436-945a-2af4f482fd80 req-4f29c62c-cd63-4501-84c9-a26bc504eccd service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:45.263920 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.compute.server_external_events [req-24b8f057-3aa4-4436-945a-2af4f482fd80 req-4f29c62c-cd63-4501-84c9-a26bc504eccd service nova] Creating event network-changed:7589b628-e985-4bc3-a2e0-858b8f897a49 for instance d834c830-cb7f-43ce-ac79-2bf168e8f664 on hv-cinder-84697 Oct 17 03:14:45.275116 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [req-24b8f057-3aa4-4436-945a-2af4f482fd80 req-4f29c62c-cd63-4501-84c9-a26bc504eccd service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045567 Oct 17 03:14:45.276051 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 225/483] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 03:14:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:14:45.458970 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-af29fe25-4ec4-4900-986a-35d7f74195a8 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:45.468574 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-af29fe25-4ec4-4900-986a-35d7f74195a8 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:45.470026 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-af29fe25-4ec4-4900-986a-35d7f74195a8 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:45.471223 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-af29fe25-4ec4-4900-986a-35d7f74195a8 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7" status: 200 len: 1809 microversion: 2.20 time: 0.256048 Oct 17 03:14:45.472089 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 259/484] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 03:14:45 2022] GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7 => generated 1809 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:14:45.746488 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-88b52ded-f898-4a47-9717-ec4374cc9749 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:14:45.747326 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-88b52ded-f898-4a47-9717-ec4374cc9749 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: 712578d1-d2fb-4252-adbb-bc87096acc00] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:14:45.753651 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-88b52ded-f898-4a47-9717-ec4374cc9749 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:45.754227 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-88b52ded-f898-4a47-9717-ec4374cc9749 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:45.754750 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-88b52ded-f898-4a47-9717-ec4374cc9749 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:45.756297 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-88b52ded-f898-4a47-9717-ec4374cc9749 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:45.756825 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-88b52ded-f898-4a47-9717-ec4374cc9749 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:45.757327 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-88b52ded-f898-4a47-9717-ec4374cc9749 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:45.933216 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-88b52ded-f898-4a47-9717-ec4374cc9749 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1787a9ef7c44e28076aaa80c0152fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee21a91b84794e80b208fe72b7f1e010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:45.942182 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-88b52ded-f898-4a47-9717-ec4374cc9749 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "GET /compute/v2.1/servers/712578d1-d2fb-4252-adbb-bc87096acc00" status: 200 len: 1369 microversion: 2.1 time: 0.199910 Oct 17 03:14:45.943898 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 226/485] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:14:45 2022] GET /compute/v2.1/servers/712578d1-d2fb-4252-adbb-bc87096acc00 => generated 1369 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:14:46.500566 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-f93b1fe0-558b-4fe3-a89b-669f9e564c6f tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:14:46.501999 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-f93b1fe0-558b-4fe3-a89b-669f9e564c6f tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 603ee2bf-bedf-4688-ac0a-77a2a50f33d7] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:14:46.520949 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-f93b1fe0-558b-4fe3-a89b-669f9e564c6f tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:46.521810 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-f93b1fe0-558b-4fe3-a89b-669f9e564c6f tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:46.522589 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-f93b1fe0-558b-4fe3-a89b-669f9e564c6f tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:46.523575 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-f93b1fe0-558b-4fe3-a89b-669f9e564c6f tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:46.524027 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-f93b1fe0-558b-4fe3-a89b-669f9e564c6f tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:46.524509 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-f93b1fe0-558b-4fe3-a89b-669f9e564c6f tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:46.675258 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-f93b1fe0-558b-4fe3-a89b-669f9e564c6f tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:46.686039 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-f93b1fe0-558b-4fe3-a89b-669f9e564c6f tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:46.697988 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-f93b1fe0-558b-4fe3-a89b-669f9e564c6f tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:46.699517 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-f93b1fe0-558b-4fe3-a89b-669f9e564c6f tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7" status: 200 len: 1809 microversion: 2.20 time: 0.203763 Oct 17 03:14:46.700620 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 260/486] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 03:14:46 2022] GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7 => generated 1809 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:14:46.972816 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-0b59ae2c-4e9f-4ce3-b280-8d22b5aac533 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:14:46.973584 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-0b59ae2c-4e9f-4ce3-b280-8d22b5aac533 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: 712578d1-d2fb-4252-adbb-bc87096acc00] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:14:46.980963 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-0b59ae2c-4e9f-4ce3-b280-8d22b5aac533 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:46.981461 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-0b59ae2c-4e9f-4ce3-b280-8d22b5aac533 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:46.982114 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-0b59ae2c-4e9f-4ce3-b280-8d22b5aac533 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:46.983026 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-0b59ae2c-4e9f-4ce3-b280-8d22b5aac533 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:46.983792 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-0b59ae2c-4e9f-4ce3-b280-8d22b5aac533 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:46.984375 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-0b59ae2c-4e9f-4ce3-b280-8d22b5aac533 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:47.145336 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-0b59ae2c-4e9f-4ce3-b280-8d22b5aac533 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1787a9ef7c44e28076aaa80c0152fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee21a91b84794e80b208fe72b7f1e010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:47.156497 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-0b59ae2c-4e9f-4ce3-b280-8d22b5aac533 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "GET /compute/v2.1/servers/712578d1-d2fb-4252-adbb-bc87096acc00" status: 200 len: 1369 microversion: 2.1 time: 0.188435 Oct 17 03:14:47.157132 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 227/487] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:14:46 2022] GET /compute/v2.1/servers/712578d1-d2fb-4252-adbb-bc87096acc00 => generated 1369 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:14:47.726284 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-9bc76a9a-63a3-4d08-bcd9-a72d3bfa61de tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:14:47.726966 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-9bc76a9a-63a3-4d08-bcd9-a72d3bfa61de tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 603ee2bf-bedf-4688-ac0a-77a2a50f33d7] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:14:47.734112 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-9bc76a9a-63a3-4d08-bcd9-a72d3bfa61de tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:47.734701 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-9bc76a9a-63a3-4d08-bcd9-a72d3bfa61de tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:47.735165 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-9bc76a9a-63a3-4d08-bcd9-a72d3bfa61de tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:47.736066 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-9bc76a9a-63a3-4d08-bcd9-a72d3bfa61de tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:47.740986 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-9bc76a9a-63a3-4d08-bcd9-a72d3bfa61de tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:47.741651 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-9bc76a9a-63a3-4d08-bcd9-a72d3bfa61de tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:47.762344 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG dbcounter [-] [118886] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:14:47.889778 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-9bc76a9a-63a3-4d08-bcd9-a72d3bfa61de tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:47.898471 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-9bc76a9a-63a3-4d08-bcd9-a72d3bfa61de tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:47.899954 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-9bc76a9a-63a3-4d08-bcd9-a72d3bfa61de tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:47.901108 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-9bc76a9a-63a3-4d08-bcd9-a72d3bfa61de tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7" status: 200 len: 1809 microversion: 2.20 time: 0.179548 Oct 17 03:14:47.901687 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 261/488] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 03:14:47 2022] GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7 => generated 1809 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 03:14:48.180459 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-4ba8dd51-e868-44c2-b59e-05397c3cebab tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:14:48.181136 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-4ba8dd51-e868-44c2-b59e-05397c3cebab tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: 712578d1-d2fb-4252-adbb-bc87096acc00] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:14:48.187563 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-4ba8dd51-e868-44c2-b59e-05397c3cebab tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:48.188053 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-4ba8dd51-e868-44c2-b59e-05397c3cebab tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:48.188506 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-4ba8dd51-e868-44c2-b59e-05397c3cebab tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:48.189199 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-4ba8dd51-e868-44c2-b59e-05397c3cebab tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:48.189657 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-4ba8dd51-e868-44c2-b59e-05397c3cebab tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:48.190084 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-4ba8dd51-e868-44c2-b59e-05397c3cebab tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:48.341877 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-4ba8dd51-e868-44c2-b59e-05397c3cebab tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1787a9ef7c44e28076aaa80c0152fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee21a91b84794e80b208fe72b7f1e010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:48.350090 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-4ba8dd51-e868-44c2-b59e-05397c3cebab tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "GET /compute/v2.1/servers/712578d1-d2fb-4252-adbb-bc87096acc00" status: 200 len: 1369 microversion: 2.1 time: 0.174174 Oct 17 03:14:48.350989 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 228/489] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:14:48 2022] GET /compute/v2.1/servers/712578d1-d2fb-4252-adbb-bc87096acc00 => generated 1369 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:14:48.929270 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-855971b0-2ff5-435a-928d-b0a58b4029fe tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:14:48.950508 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-855971b0-2ff5-435a-928d-b0a58b4029fe tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 603ee2bf-bedf-4688-ac0a-77a2a50f33d7] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:14:48.958857 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-855971b0-2ff5-435a-928d-b0a58b4029fe tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:48.959676 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-855971b0-2ff5-435a-928d-b0a58b4029fe tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:48.960142 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-855971b0-2ff5-435a-928d-b0a58b4029fe tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:48.960854 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-855971b0-2ff5-435a-928d-b0a58b4029fe tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:48.961309 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-855971b0-2ff5-435a-928d-b0a58b4029fe tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:48.968847 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-855971b0-2ff5-435a-928d-b0a58b4029fe tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:49.133831 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-855971b0-2ff5-435a-928d-b0a58b4029fe tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:49.154803 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-855971b0-2ff5-435a-928d-b0a58b4029fe tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:49.158064 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-855971b0-2ff5-435a-928d-b0a58b4029fe tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:49.159742 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-855971b0-2ff5-435a-928d-b0a58b4029fe tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7" status: 200 len: 1809 microversion: 2.20 time: 0.235015 Oct 17 03:14:49.175349 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 262/490] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 03:14:48 2022] GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7 => generated 1809 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 03:14:49.378051 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-2bcd1ee1-5cbb-4021-b6a9-8aa5b82eb461 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:14:49.378694 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-2bcd1ee1-5cbb-4021-b6a9-8aa5b82eb461 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: 712578d1-d2fb-4252-adbb-bc87096acc00] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:14:49.385431 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-2bcd1ee1-5cbb-4021-b6a9-8aa5b82eb461 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:49.386021 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-2bcd1ee1-5cbb-4021-b6a9-8aa5b82eb461 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:49.386510 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-2bcd1ee1-5cbb-4021-b6a9-8aa5b82eb461 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:49.387305 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-2bcd1ee1-5cbb-4021-b6a9-8aa5b82eb461 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:49.387808 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-2bcd1ee1-5cbb-4021-b6a9-8aa5b82eb461 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:49.388268 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-2bcd1ee1-5cbb-4021-b6a9-8aa5b82eb461 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:49.540115 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-2bcd1ee1-5cbb-4021-b6a9-8aa5b82eb461 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1787a9ef7c44e28076aaa80c0152fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee21a91b84794e80b208fe72b7f1e010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:49.548662 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-2bcd1ee1-5cbb-4021-b6a9-8aa5b82eb461 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "GET /compute/v2.1/servers/712578d1-d2fb-4252-adbb-bc87096acc00" status: 200 len: 1369 microversion: 2.1 time: 0.175087 Oct 17 03:14:49.559488 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 229/491] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:14:49 2022] GET /compute/v2.1/servers/712578d1-d2fb-4252-adbb-bc87096acc00 => generated 1369 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:14:50.194229 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-9f77eb1f-052f-4ec5-98d4-8ad511a3faef tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:14:50.195085 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-9f77eb1f-052f-4ec5-98d4-8ad511a3faef tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 603ee2bf-bedf-4688-ac0a-77a2a50f33d7] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:14:50.206328 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-9f77eb1f-052f-4ec5-98d4-8ad511a3faef tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:50.206815 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-9f77eb1f-052f-4ec5-98d4-8ad511a3faef tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:50.207743 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-9f77eb1f-052f-4ec5-98d4-8ad511a3faef tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:50.219648 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-9f77eb1f-052f-4ec5-98d4-8ad511a3faef tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:50.219648 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-9f77eb1f-052f-4ec5-98d4-8ad511a3faef tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:50.219648 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-9f77eb1f-052f-4ec5-98d4-8ad511a3faef tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:50.367038 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-9f77eb1f-052f-4ec5-98d4-8ad511a3faef tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:50.376198 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-9f77eb1f-052f-4ec5-98d4-8ad511a3faef tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:50.379402 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-9f77eb1f-052f-4ec5-98d4-8ad511a3faef tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:50.379612 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-9f77eb1f-052f-4ec5-98d4-8ad511a3faef tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7" status: 200 len: 1809 microversion: 2.20 time: 0.189957 Oct 17 03:14:50.380651 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 263/492] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 03:14:50 2022] GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7 => generated 1809 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:14:50.572872 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-8c64f4de-d2ce-45e4-bebe-89acd5cf3224 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:14:50.574245 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-8c64f4de-d2ce-45e4-bebe-89acd5cf3224 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: 712578d1-d2fb-4252-adbb-bc87096acc00] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:14:50.581197 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-8c64f4de-d2ce-45e4-bebe-89acd5cf3224 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:50.581684 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-8c64f4de-d2ce-45e4-bebe-89acd5cf3224 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:50.582319 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-8c64f4de-d2ce-45e4-bebe-89acd5cf3224 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:50.583104 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-8c64f4de-d2ce-45e4-bebe-89acd5cf3224 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:50.583711 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-8c64f4de-d2ce-45e4-bebe-89acd5cf3224 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:50.585968 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-8c64f4de-d2ce-45e4-bebe-89acd5cf3224 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:50.743906 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-8c64f4de-d2ce-45e4-bebe-89acd5cf3224 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1787a9ef7c44e28076aaa80c0152fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee21a91b84794e80b208fe72b7f1e010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:50.752025 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-8c64f4de-d2ce-45e4-bebe-89acd5cf3224 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "GET /compute/v2.1/servers/712578d1-d2fb-4252-adbb-bc87096acc00" status: 200 len: 1369 microversion: 2.1 time: 0.183024 Oct 17 03:14:50.752593 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 230/493] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:14:50 2022] GET /compute/v2.1/servers/712578d1-d2fb-4252-adbb-bc87096acc00 => generated 1369 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:14:51.406036 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-f79b68ca-8a54-4773-ab1b-438c3359abcf tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:14:51.406649 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-f79b68ca-8a54-4773-ab1b-438c3359abcf tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 603ee2bf-bedf-4688-ac0a-77a2a50f33d7] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:14:51.413365 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-f79b68ca-8a54-4773-ab1b-438c3359abcf tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:51.413845 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-f79b68ca-8a54-4773-ab1b-438c3359abcf tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:51.414280 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-f79b68ca-8a54-4773-ab1b-438c3359abcf tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:51.415002 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-f79b68ca-8a54-4773-ab1b-438c3359abcf tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:51.415457 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-f79b68ca-8a54-4773-ab1b-438c3359abcf tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:51.415885 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-f79b68ca-8a54-4773-ab1b-438c3359abcf tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:51.756697 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-f79b68ca-8a54-4773-ab1b-438c3359abcf tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:51.765882 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-f79b68ca-8a54-4773-ab1b-438c3359abcf tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:51.767395 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-f79b68ca-8a54-4773-ab1b-438c3359abcf tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:51.768588 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-f79b68ca-8a54-4773-ab1b-438c3359abcf tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7" status: 200 len: 1809 microversion: 2.20 time: 0.366835 Oct 17 03:14:51.769144 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 264/494] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 03:14:51 2022] GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7 => generated 1809 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:14:51.777468 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-66d48e63-7bb3-499d-9009-13c21ab3247d tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:14:51.778782 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-66d48e63-7bb3-499d-9009-13c21ab3247d tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: 712578d1-d2fb-4252-adbb-bc87096acc00] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:14:51.785750 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-66d48e63-7bb3-499d-9009-13c21ab3247d tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:51.786268 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-66d48e63-7bb3-499d-9009-13c21ab3247d tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:51.786725 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-66d48e63-7bb3-499d-9009-13c21ab3247d tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:51.787465 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-66d48e63-7bb3-499d-9009-13c21ab3247d tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:51.787964 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-66d48e63-7bb3-499d-9009-13c21ab3247d tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:51.789895 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-66d48e63-7bb3-499d-9009-13c21ab3247d tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:51.810184 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG dbcounter [-] [118887] Writing DB stats nova_cell1:SELECT=100 {{(pid=118887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:14:51.929726 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-66d48e63-7bb3-499d-9009-13c21ab3247d tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1787a9ef7c44e28076aaa80c0152fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee21a91b84794e80b208fe72b7f1e010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:51.940779 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-66d48e63-7bb3-499d-9009-13c21ab3247d tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "GET /compute/v2.1/servers/712578d1-d2fb-4252-adbb-bc87096acc00" status: 200 len: 1369 microversion: 2.1 time: 0.167432 Oct 17 03:14:51.941344 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 231/495] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:14:51 2022] GET /compute/v2.1/servers/712578d1-d2fb-4252-adbb-bc87096acc00 => generated 1369 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:14:52.798232 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-347d5cfc-74eb-4ae9-a243-3713fa4ca215 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:14:52.799686 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-347d5cfc-74eb-4ae9-a243-3713fa4ca215 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 603ee2bf-bedf-4688-ac0a-77a2a50f33d7] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:14:52.807065 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-347d5cfc-74eb-4ae9-a243-3713fa4ca215 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:52.807828 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-347d5cfc-74eb-4ae9-a243-3713fa4ca215 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:52.808315 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-347d5cfc-74eb-4ae9-a243-3713fa4ca215 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:52.809026 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-347d5cfc-74eb-4ae9-a243-3713fa4ca215 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:52.809432 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-347d5cfc-74eb-4ae9-a243-3713fa4ca215 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:52.809857 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-347d5cfc-74eb-4ae9-a243-3713fa4ca215 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:52.949739 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-347d5cfc-74eb-4ae9-a243-3713fa4ca215 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:52.960408 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-347d5cfc-74eb-4ae9-a243-3713fa4ca215 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:52.961885 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-347d5cfc-74eb-4ae9-a243-3713fa4ca215 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:52.963175 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-347d5cfc-74eb-4ae9-a243-3713fa4ca215 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7" status: 200 len: 1809 microversion: 2.20 time: 0.168852 Oct 17 03:14:52.963740 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 265/496] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 03:14:52 2022] GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7 => generated 1809 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:14:52.964723 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-018d1754-0b67-45e5-8153-9bcdd342e6e1 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:14:52.966012 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-018d1754-0b67-45e5-8153-9bcdd342e6e1 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: 712578d1-d2fb-4252-adbb-bc87096acc00] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:14:52.974732 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-018d1754-0b67-45e5-8153-9bcdd342e6e1 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:52.975357 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-018d1754-0b67-45e5-8153-9bcdd342e6e1 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:52.976188 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-018d1754-0b67-45e5-8153-9bcdd342e6e1 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:52.977146 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-018d1754-0b67-45e5-8153-9bcdd342e6e1 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:52.977823 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-018d1754-0b67-45e5-8153-9bcdd342e6e1 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:52.978656 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-018d1754-0b67-45e5-8153-9bcdd342e6e1 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:53.144483 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-018d1754-0b67-45e5-8153-9bcdd342e6e1 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1787a9ef7c44e28076aaa80c0152fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee21a91b84794e80b208fe72b7f1e010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:53.152581 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-018d1754-0b67-45e5-8153-9bcdd342e6e1 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "GET /compute/v2.1/servers/712578d1-d2fb-4252-adbb-bc87096acc00" status: 200 len: 1369 microversion: 2.1 time: 0.191952 Oct 17 03:14:53.153151 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 232/497] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:14:52 2022] GET /compute/v2.1/servers/712578d1-d2fb-4252-adbb-bc87096acc00 => generated 1369 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:14:53.991554 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-c60087fe-3bcd-4e34-ac57-73a3501ae055 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:14:53.992172 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-c60087fe-3bcd-4e34-ac57-73a3501ae055 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 603ee2bf-bedf-4688-ac0a-77a2a50f33d7] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:14:53.998533 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-c60087fe-3bcd-4e34-ac57-73a3501ae055 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:53.999040 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-c60087fe-3bcd-4e34-ac57-73a3501ae055 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:53.999467 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-c60087fe-3bcd-4e34-ac57-73a3501ae055 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:54.000145 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-c60087fe-3bcd-4e34-ac57-73a3501ae055 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:54.000588 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-c60087fe-3bcd-4e34-ac57-73a3501ae055 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:54.001001 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-c60087fe-3bcd-4e34-ac57-73a3501ae055 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:54.133961 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-c60087fe-3bcd-4e34-ac57-73a3501ae055 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:54.142523 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-c60087fe-3bcd-4e34-ac57-73a3501ae055 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:54.144017 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-c60087fe-3bcd-4e34-ac57-73a3501ae055 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:54.145149 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-c60087fe-3bcd-4e34-ac57-73a3501ae055 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7" status: 200 len: 1809 microversion: 2.20 time: 0.157605 Oct 17 03:14:54.145696 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 266/498] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 03:14:53 2022] GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7 => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 03:14:54.176202 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-b14e6899-b051-4342-8a9b-ef26e1c7570d tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:14:54.176955 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-b14e6899-b051-4342-8a9b-ef26e1c7570d tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: 712578d1-d2fb-4252-adbb-bc87096acc00] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:14:54.183461 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-b14e6899-b051-4342-8a9b-ef26e1c7570d tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:54.183970 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-b14e6899-b051-4342-8a9b-ef26e1c7570d tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:54.184404 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-b14e6899-b051-4342-8a9b-ef26e1c7570d tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:54.185129 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-b14e6899-b051-4342-8a9b-ef26e1c7570d tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:54.185606 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-b14e6899-b051-4342-8a9b-ef26e1c7570d tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:54.186036 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-b14e6899-b051-4342-8a9b-ef26e1c7570d tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:54.322420 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-b14e6899-b051-4342-8a9b-ef26e1c7570d tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1787a9ef7c44e28076aaa80c0152fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee21a91b84794e80b208fe72b7f1e010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:54.329281 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-b14e6899-b051-4342-8a9b-ef26e1c7570d tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "GET /compute/v2.1/servers/712578d1-d2fb-4252-adbb-bc87096acc00" status: 200 len: 1369 microversion: 2.1 time: 0.156820 Oct 17 03:14:54.329862 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 233/499] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:14:54 2022] GET /compute/v2.1/servers/712578d1-d2fb-4252-adbb-bc87096acc00 => generated 1369 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:14:54.412653 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-daed787f-0345-4d98-be7a-2422cbf125ac tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-995924301", "imageRef": "e6d41914-f1bc-4b72-9113-1a69b3d0d83b", "flavorRef": "452", "networks": [{"uuid": "8f1e2c13-b4f2-4e53-81bc-b89ddf861600"}]}} {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:14:54.479179 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.network.neutron [None req-daed787f-0345-4d98-be7a-2422cbf125ac tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] validate_networks() for [('8f1e2c13-b4f2-4e53-81bc-b89ddf861600', None, None, None, None, None)] {{(pid=118886) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 03:14:54.842017 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.virt.hardware [None req-daed787f-0345-4d98-be7a-2422cbf125ac tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Flavor limits 0:0:0 {{(pid=118886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 03:14:54.842441 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.virt.hardware [None req-daed787f-0345-4d98-be7a-2422cbf125ac tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Image limits 0:0:0 {{(pid=118886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 03:14:54.842954 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.virt.hardware [None req-daed787f-0345-4d98-be7a-2422cbf125ac tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Flavor pref 0:0:0 {{(pid=118886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 03:14:54.843367 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.virt.hardware [None req-daed787f-0345-4d98-be7a-2422cbf125ac tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Image pref 0:0:0 {{(pid=118886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 03:14:54.843780 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.virt.hardware [None req-daed787f-0345-4d98-be7a-2422cbf125ac tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 03:14:54.853056 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-daed787f-0345-4d98-be7a-2422cbf125ac tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:54.853536 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-daed787f-0345-4d98-be7a-2422cbf125ac tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:54.853969 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-daed787f-0345-4d98-be7a-2422cbf125ac tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:54.854696 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-daed787f-0345-4d98-be7a-2422cbf125ac tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:54.855182 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-daed787f-0345-4d98-be7a-2422cbf125ac tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:54.855611 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-daed787f-0345-4d98-be7a-2422cbf125ac tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:54.872598 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.quota [None req-daed787f-0345-4d98-be7a-2422cbf125ac tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Getting quotas for project 0d285ecc0c5343b1b4001594013cd447. Resources: {'instances', 'cores', 'ram'} {{(pid=118886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 03:14:54.876595 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.quota [None req-daed787f-0345-4d98-be7a-2422cbf125ac tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Getting quotas for user 7cc092c3cc0b4fbc9b420b8c7916132a and project 0d285ecc0c5343b1b4001594013cd447. Resources: {'instances', 'cores', 'ram'} {{(pid=118886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 03:14:54.887618 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-daed787f-0345-4d98-be7a-2422cbf125ac tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Going to run 1 instances... {{(pid=118886) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 03:14:54.889870 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-daed787f-0345-4d98-be7a-2422cbf125ac tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] [instance: 5545b41c-d358-4568-a79c-da1f0c2e1700] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e6d41914-f1bc-4b72-9113-1a69b3d0d83b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 03:14:54.936159 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-daed787f-0345-4d98-be7a-2422cbf125ac tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.528127 Oct 17 03:14:54.936808 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 267/500] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 03:14:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 530 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 03:14:54.947706 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-27b09a97-27c5-4bd6-ae22-fbb735919d14 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:14:54.948316 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-27b09a97-27c5-4bd6-ae22-fbb735919d14 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] [instance: 5545b41c-d358-4568-a79c-da1f0c2e1700] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:14:55.003790 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-27b09a97-27c5-4bd6-ae22-fbb735919d14 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc092c3cc0b4fbc9b420b8c7916132a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d285ecc0c5343b1b4001594013cd447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:55.010678 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-27b09a97-27c5-4bd6-ae22-fbb735919d14 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] 10.222.0.27 "GET /compute/v2.1/servers/5545b41c-d358-4568-a79c-da1f0c2e1700" status: 200 len: 1218 microversion: 2.1 time: 0.066783 Oct 17 03:14:55.011727 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 234/501] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:14:54 2022] GET /compute/v2.1/servers/5545b41c-d358-4568-a79c-da1f0c2e1700 => generated 1218 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:14:55.171523 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-14e50423-cbdc-4614-b7d4-03d5b1a5ef0e tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:14:55.172167 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-14e50423-cbdc-4614-b7d4-03d5b1a5ef0e tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 603ee2bf-bedf-4688-ac0a-77a2a50f33d7] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:14:55.179530 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-14e50423-cbdc-4614-b7d4-03d5b1a5ef0e tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:55.180023 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-14e50423-cbdc-4614-b7d4-03d5b1a5ef0e tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:55.180456 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-14e50423-cbdc-4614-b7d4-03d5b1a5ef0e tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:55.181164 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-14e50423-cbdc-4614-b7d4-03d5b1a5ef0e tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:55.181615 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-14e50423-cbdc-4614-b7d4-03d5b1a5ef0e tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:55.182048 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-14e50423-cbdc-4614-b7d4-03d5b1a5ef0e tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:55.342779 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-14e50423-cbdc-4614-b7d4-03d5b1a5ef0e tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:55.353307 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-88c2869a-9f51-4a9f-9177-35d11eee2321 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:14:55.353910 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-88c2869a-9f51-4a9f-9177-35d11eee2321 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: 712578d1-d2fb-4252-adbb-bc87096acc00] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:14:55.354791 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-14e50423-cbdc-4614-b7d4-03d5b1a5ef0e tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:55.356460 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-14e50423-cbdc-4614-b7d4-03d5b1a5ef0e tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:55.357782 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-14e50423-cbdc-4614-b7d4-03d5b1a5ef0e tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7" status: 200 len: 1809 microversion: 2.20 time: 0.190678 Oct 17 03:14:55.363238 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 268/502] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 03:14:55 2022] GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7 => generated 1809 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:14:55.371268 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-88c2869a-9f51-4a9f-9177-35d11eee2321 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:55.373668 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-88c2869a-9f51-4a9f-9177-35d11eee2321 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:55.376012 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-88c2869a-9f51-4a9f-9177-35d11eee2321 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:55.376823 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-88c2869a-9f51-4a9f-9177-35d11eee2321 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:55.377245 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-88c2869a-9f51-4a9f-9177-35d11eee2321 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:55.377705 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-88c2869a-9f51-4a9f-9177-35d11eee2321 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:55.514709 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-88c2869a-9f51-4a9f-9177-35d11eee2321 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1787a9ef7c44e28076aaa80c0152fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee21a91b84794e80b208fe72b7f1e010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:55.523423 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-88c2869a-9f51-4a9f-9177-35d11eee2321 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "GET /compute/v2.1/servers/712578d1-d2fb-4252-adbb-bc87096acc00" status: 200 len: 1564 microversion: 2.1 time: 0.174553 Oct 17 03:14:55.523968 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 235/503] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:14:55 2022] GET /compute/v2.1/servers/712578d1-d2fb-4252-adbb-bc87096acc00 => generated 1564 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:14:55.545979 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-03ebe766-7715-4a39-971d-42334b45d32c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:14:55.546468 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-03ebe766-7715-4a39-971d-42334b45d32c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: 712578d1-d2fb-4252-adbb-bc87096acc00] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:14:55.552378 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-03ebe766-7715-4a39-971d-42334b45d32c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:55.552882 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-03ebe766-7715-4a39-971d-42334b45d32c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:55.553317 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-03ebe766-7715-4a39-971d-42334b45d32c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:55.553999 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-03ebe766-7715-4a39-971d-42334b45d32c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:55.554448 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-03ebe766-7715-4a39-971d-42334b45d32c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:55.554890 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-03ebe766-7715-4a39-971d-42334b45d32c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:55.630261 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-03ebe766-7715-4a39-971d-42334b45d32c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "GET /compute/v2.1/servers/712578d1-d2fb-4252-adbb-bc87096acc00/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.088066 Oct 17 03:14:55.631414 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 269/504] 10.222.0.27 () {58 vars in 1275 bytes} [Mon Oct 17 03:14:55 2022] GET /compute/v2.1/servers/712578d1-d2fb-4252-adbb-bc87096acc00/os-interface => generated 285 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:14:56.035530 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-c042872d-c296-4fb5-b49b-3e1d44ee46b3 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:14:56.036976 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-c042872d-c296-4fb5-b49b-3e1d44ee46b3 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] [instance: 5545b41c-d358-4568-a79c-da1f0c2e1700] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:14:56.057251 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-c042872d-c296-4fb5-b49b-3e1d44ee46b3 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:56.058159 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-c042872d-c296-4fb5-b49b-3e1d44ee46b3 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:56.058798 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-c042872d-c296-4fb5-b49b-3e1d44ee46b3 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:56.060613 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-c042872d-c296-4fb5-b49b-3e1d44ee46b3 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:56.062576 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-c042872d-c296-4fb5-b49b-3e1d44ee46b3 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:56.063258 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-c042872d-c296-4fb5-b49b-3e1d44ee46b3 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:56.200837 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-c042872d-c296-4fb5-b49b-3e1d44ee46b3 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc092c3cc0b4fbc9b420b8c7916132a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d285ecc0c5343b1b4001594013cd447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:56.209494 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-c042872d-c296-4fb5-b49b-3e1d44ee46b3 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] 10.222.0.27 "GET /compute/v2.1/servers/5545b41c-d358-4568-a79c-da1f0c2e1700" status: 200 len: 1222 microversion: 2.1 time: 0.179621 Oct 17 03:14:56.210522 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 236/505] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:14:56 2022] GET /compute/v2.1/servers/5545b41c-d358-4568-a79c-da1f0c2e1700 => generated 1222 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:14:56.383954 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-d9752e8d-6d43-4260-88c8-8d0adc84b1de tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:14:56.384559 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-d9752e8d-6d43-4260-88c8-8d0adc84b1de tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 603ee2bf-bedf-4688-ac0a-77a2a50f33d7] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:14:56.390524 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-d9752e8d-6d43-4260-88c8-8d0adc84b1de tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:56.391033 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-d9752e8d-6d43-4260-88c8-8d0adc84b1de tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:56.391457 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-d9752e8d-6d43-4260-88c8-8d0adc84b1de tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:56.393721 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-d9752e8d-6d43-4260-88c8-8d0adc84b1de tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:56.394218 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-d9752e8d-6d43-4260-88c8-8d0adc84b1de tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:56.394643 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-d9752e8d-6d43-4260-88c8-8d0adc84b1de tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:56.542263 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-d9752e8d-6d43-4260-88c8-8d0adc84b1de tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:56.551957 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-d9752e8d-6d43-4260-88c8-8d0adc84b1de tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:56.555034 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-d9752e8d-6d43-4260-88c8-8d0adc84b1de tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:56.556226 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-d9752e8d-6d43-4260-88c8-8d0adc84b1de tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7" status: 200 len: 1809 microversion: 2.20 time: 0.176972 Oct 17 03:14:56.557100 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 270/506] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 03:14:56 2022] GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7 => generated 1809 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:14:57.232275 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-99e86fbc-cba5-4b90-bf2e-759dd387890f tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:14:57.233084 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-99e86fbc-cba5-4b90-bf2e-759dd387890f tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] [instance: 5545b41c-d358-4568-a79c-da1f0c2e1700] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:14:57.240892 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-99e86fbc-cba5-4b90-bf2e-759dd387890f tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:57.241518 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-99e86fbc-cba5-4b90-bf2e-759dd387890f tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:57.242031 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-99e86fbc-cba5-4b90-bf2e-759dd387890f tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:57.242814 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-99e86fbc-cba5-4b90-bf2e-759dd387890f tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:57.243389 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-99e86fbc-cba5-4b90-bf2e-759dd387890f tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:57.243887 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-99e86fbc-cba5-4b90-bf2e-759dd387890f tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:57.391072 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-99e86fbc-cba5-4b90-bf2e-759dd387890f tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc092c3cc0b4fbc9b420b8c7916132a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d285ecc0c5343b1b4001594013cd447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:57.403171 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-99e86fbc-cba5-4b90-bf2e-759dd387890f tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] 10.222.0.27 "GET /compute/v2.1/servers/5545b41c-d358-4568-a79c-da1f0c2e1700" status: 200 len: 1278 microversion: 2.1 time: 0.172405 Oct 17 03:14:57.403171 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 237/507] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:14:57 2022] GET /compute/v2.1/servers/5545b41c-d358-4568-a79c-da1f0c2e1700 => generated 1278 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:14:57.422335 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [req-e86af8e1-a40d-4c56-a686-29e589744d78 req-f13b4f5f-09a0-4e9e-be61-ab734909ce7c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "712578d1-d2fb-4252-adbb-bc87096acc00", "tag": "f7a1e8a6-f7aa-40af-a627-0640f636cc4a"}]} {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:14:57.436011 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [req-e86af8e1-a40d-4c56-a686-29e589744d78 req-f13b4f5f-09a0-4e9e-be61-ab734909ce7c service nova] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:57.436535 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [req-e86af8e1-a40d-4c56-a686-29e589744d78 req-f13b4f5f-09a0-4e9e-be61-ab734909ce7c service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:57.437177 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [req-e86af8e1-a40d-4c56-a686-29e589744d78 req-f13b4f5f-09a0-4e9e-be61-ab734909ce7c service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:57.451130 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.compute.server_external_events [req-e86af8e1-a40d-4c56-a686-29e589744d78 req-f13b4f5f-09a0-4e9e-be61-ab734909ce7c service nova] Creating event network-changed:f7a1e8a6-f7aa-40af-a627-0640f636cc4a for instance 712578d1-d2fb-4252-adbb-bc87096acc00 on hv-cinder-84697 Oct 17 03:14:57.457105 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [req-e86af8e1-a40d-4c56-a686-29e589744d78 req-f13b4f5f-09a0-4e9e-be61-ab734909ce7c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038088 Oct 17 03:14:57.457682 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 271/508] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 03:14:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:14:57.581903 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-6fdabddd-fcfd-41d7-b84c-610ff45c7166 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:14:57.582523 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-6fdabddd-fcfd-41d7-b84c-610ff45c7166 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 603ee2bf-bedf-4688-ac0a-77a2a50f33d7] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:14:57.589107 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-6fdabddd-fcfd-41d7-b84c-610ff45c7166 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:57.589601 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-6fdabddd-fcfd-41d7-b84c-610ff45c7166 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:57.590034 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-6fdabddd-fcfd-41d7-b84c-610ff45c7166 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:57.591118 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-6fdabddd-fcfd-41d7-b84c-610ff45c7166 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:57.591580 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-6fdabddd-fcfd-41d7-b84c-610ff45c7166 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:57.592008 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-6fdabddd-fcfd-41d7-b84c-610ff45c7166 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:57.981955 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-6fdabddd-fcfd-41d7-b84c-610ff45c7166 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:57.991828 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-6fdabddd-fcfd-41d7-b84c-610ff45c7166 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:57.993421 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-6fdabddd-fcfd-41d7-b84c-610ff45c7166 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:57.995026 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-6fdabddd-fcfd-41d7-b84c-610ff45c7166 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7" status: 200 len: 1809 microversion: 2.20 time: 0.417170 Oct 17 03:14:58.010889 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 238/509] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 03:14:57 2022] GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7 => generated 1809 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:14:58.424793 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-634f9d2c-b7ca-455d-ac01-c19817634656 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:14:58.426108 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-634f9d2c-b7ca-455d-ac01-c19817634656 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] [instance: 5545b41c-d358-4568-a79c-da1f0c2e1700] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:14:58.433574 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-634f9d2c-b7ca-455d-ac01-c19817634656 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:58.434482 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-634f9d2c-b7ca-455d-ac01-c19817634656 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:58.435309 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-634f9d2c-b7ca-455d-ac01-c19817634656 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:58.436193 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-634f9d2c-b7ca-455d-ac01-c19817634656 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:58.436767 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-634f9d2c-b7ca-455d-ac01-c19817634656 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:58.437187 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-634f9d2c-b7ca-455d-ac01-c19817634656 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:58.619066 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-634f9d2c-b7ca-455d-ac01-c19817634656 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc092c3cc0b4fbc9b420b8c7916132a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d285ecc0c5343b1b4001594013cd447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:58.626776 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-634f9d2c-b7ca-455d-ac01-c19817634656 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] 10.222.0.27 "GET /compute/v2.1/servers/5545b41c-d358-4568-a79c-da1f0c2e1700" status: 200 len: 1318 microversion: 2.1 time: 0.206371 Oct 17 03:14:58.627868 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 272/510] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:14:58 2022] GET /compute/v2.1/servers/5545b41c-d358-4568-a79c-da1f0c2e1700 => generated 1318 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:14:59.022961 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-cfb49fbb-aa34-47ea-add1-e9e581f614f3 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:14:59.023559 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-cfb49fbb-aa34-47ea-add1-e9e581f614f3 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 603ee2bf-bedf-4688-ac0a-77a2a50f33d7] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:14:59.030241 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-cfb49fbb-aa34-47ea-add1-e9e581f614f3 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:59.031039 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-cfb49fbb-aa34-47ea-add1-e9e581f614f3 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:59.031472 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-cfb49fbb-aa34-47ea-add1-e9e581f614f3 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:59.032161 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-cfb49fbb-aa34-47ea-add1-e9e581f614f3 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:59.032606 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-cfb49fbb-aa34-47ea-add1-e9e581f614f3 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:59.033021 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-cfb49fbb-aa34-47ea-add1-e9e581f614f3 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:59.273975 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-cfb49fbb-aa34-47ea-add1-e9e581f614f3 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:59.285855 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-cfb49fbb-aa34-47ea-add1-e9e581f614f3 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:59.287983 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-cfb49fbb-aa34-47ea-add1-e9e581f614f3 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:14:59.289137 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-cfb49fbb-aa34-47ea-add1-e9e581f614f3 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7" status: 200 len: 1809 microversion: 2.20 time: 0.270974 Oct 17 03:14:59.289890 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 239/511] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 03:14:59 2022] GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7 => generated 1809 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:14:59.493323 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [req-1b019f46-4720-4a5d-af93-c29c675bef0f req-c905bb4a-ed49-4c07-ba22-12ec943080c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5545b41c-d358-4568-a79c-da1f0c2e1700", "tag": "cb27a482-79a3-49f6-be43-6876d0f79519"}]} {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:14:59.503610 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [req-1b019f46-4720-4a5d-af93-c29c675bef0f req-c905bb4a-ed49-4c07-ba22-12ec943080c0 service nova] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:59.504270 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [req-1b019f46-4720-4a5d-af93-c29c675bef0f req-c905bb4a-ed49-4c07-ba22-12ec943080c0 service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:59.504500 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [req-1b019f46-4720-4a5d-af93-c29c675bef0f req-c905bb4a-ed49-4c07-ba22-12ec943080c0 service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:59.516481 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.compute.server_external_events [req-1b019f46-4720-4a5d-af93-c29c675bef0f req-c905bb4a-ed49-4c07-ba22-12ec943080c0 service nova] Creating event network-changed:cb27a482-79a3-49f6-be43-6876d0f79519 for instance 5545b41c-d358-4568-a79c-da1f0c2e1700 on hv-cinder-84697 Oct 17 03:14:59.521316 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [req-1b019f46-4720-4a5d-af93-c29c675bef0f req-c905bb4a-ed49-4c07-ba22-12ec943080c0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032057 Oct 17 03:14:59.522480 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 273/512] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 03:14:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:14:59.651403 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-e5365a96-5ec6-4621-8d89-1f51f6b72a6b tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:14:59.652006 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-e5365a96-5ec6-4621-8d89-1f51f6b72a6b tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] [instance: 5545b41c-d358-4568-a79c-da1f0c2e1700] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:14:59.658117 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-e5365a96-5ec6-4621-8d89-1f51f6b72a6b tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:59.658591 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-e5365a96-5ec6-4621-8d89-1f51f6b72a6b tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:59.659058 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-e5365a96-5ec6-4621-8d89-1f51f6b72a6b tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:14:59.659739 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-e5365a96-5ec6-4621-8d89-1f51f6b72a6b tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:14:59.660186 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-e5365a96-5ec6-4621-8d89-1f51f6b72a6b tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:14:59.660600 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-e5365a96-5ec6-4621-8d89-1f51f6b72a6b tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:15:00.120173 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-e5365a96-5ec6-4621-8d89-1f51f6b72a6b tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc092c3cc0b4fbc9b420b8c7916132a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d285ecc0c5343b1b4001594013cd447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:15:00.127857 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-e5365a96-5ec6-4621-8d89-1f51f6b72a6b tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] 10.222.0.27 "GET /compute/v2.1/servers/5545b41c-d358-4568-a79c-da1f0c2e1700" status: 200 len: 1318 microversion: 2.1 time: 0.480404 Oct 17 03:15:00.128481 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 240/513] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:14:59 2022] GET /compute/v2.1/servers/5545b41c-d358-4568-a79c-da1f0c2e1700 => generated 1318 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:15:00.314125 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-8d7ebacd-bb11-4127-a3f0-97bc75eb08ea tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:15:00.314815 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-8d7ebacd-bb11-4127-a3f0-97bc75eb08ea tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 603ee2bf-bedf-4688-ac0a-77a2a50f33d7] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:15:00.321499 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-8d7ebacd-bb11-4127-a3f0-97bc75eb08ea tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:15:00.321978 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-8d7ebacd-bb11-4127-a3f0-97bc75eb08ea tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:15:00.322411 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-8d7ebacd-bb11-4127-a3f0-97bc75eb08ea tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:15:00.323186 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-8d7ebacd-bb11-4127-a3f0-97bc75eb08ea tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:15:00.323644 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-8d7ebacd-bb11-4127-a3f0-97bc75eb08ea tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:15:00.324066 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-8d7ebacd-bb11-4127-a3f0-97bc75eb08ea tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:15:00.456731 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-8d7ebacd-bb11-4127-a3f0-97bc75eb08ea tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:15:00.465663 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-8d7ebacd-bb11-4127-a3f0-97bc75eb08ea tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:15:00.467114 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-8d7ebacd-bb11-4127-a3f0-97bc75eb08ea tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:15:00.468284 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-8d7ebacd-bb11-4127-a3f0-97bc75eb08ea tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7" status: 200 len: 1809 microversion: 2.20 time: 0.158469 Oct 17 03:15:00.468836 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 274/514] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 03:15:00 2022] GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7 => generated 1809 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:15:01.150816 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-d20cc6a6-51e9-48b7-9567-f8fc77b1f8e8 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:15:01.151525 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-d20cc6a6-51e9-48b7-9567-f8fc77b1f8e8 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] [instance: 5545b41c-d358-4568-a79c-da1f0c2e1700] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:15:01.158295 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-d20cc6a6-51e9-48b7-9567-f8fc77b1f8e8 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:15:01.158784 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-d20cc6a6-51e9-48b7-9567-f8fc77b1f8e8 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:15:01.159243 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-d20cc6a6-51e9-48b7-9567-f8fc77b1f8e8 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:15:01.159935 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-d20cc6a6-51e9-48b7-9567-f8fc77b1f8e8 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:15:01.160390 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-d20cc6a6-51e9-48b7-9567-f8fc77b1f8e8 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:15:01.160809 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-d20cc6a6-51e9-48b7-9567-f8fc77b1f8e8 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:15:01.302239 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-d20cc6a6-51e9-48b7-9567-f8fc77b1f8e8 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc092c3cc0b4fbc9b420b8c7916132a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d285ecc0c5343b1b4001594013cd447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:15:01.310215 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-d20cc6a6-51e9-48b7-9567-f8fc77b1f8e8 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] 10.222.0.27 "GET /compute/v2.1/servers/5545b41c-d358-4568-a79c-da1f0c2e1700" status: 200 len: 1318 microversion: 2.1 time: 0.163208 Oct 17 03:15:01.310779 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 241/515] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:15:01 2022] GET /compute/v2.1/servers/5545b41c-d358-4568-a79c-da1f0c2e1700 => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:15:01.493701 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-bfc0e7f5-7bf7-4b7e-a070-9a1d2cb0d5a7 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:15:01.494283 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-bfc0e7f5-7bf7-4b7e-a070-9a1d2cb0d5a7 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 603ee2bf-bedf-4688-ac0a-77a2a50f33d7] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:15:01.500723 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-bfc0e7f5-7bf7-4b7e-a070-9a1d2cb0d5a7 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:15:01.501199 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-bfc0e7f5-7bf7-4b7e-a070-9a1d2cb0d5a7 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:15:01.501661 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-bfc0e7f5-7bf7-4b7e-a070-9a1d2cb0d5a7 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:15:01.502346 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-bfc0e7f5-7bf7-4b7e-a070-9a1d2cb0d5a7 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:15:01.502795 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-bfc0e7f5-7bf7-4b7e-a070-9a1d2cb0d5a7 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:15:01.503296 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-bfc0e7f5-7bf7-4b7e-a070-9a1d2cb0d5a7 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:15:01.629371 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-bfc0e7f5-7bf7-4b7e-a070-9a1d2cb0d5a7 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:15:01.639226 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-bfc0e7f5-7bf7-4b7e-a070-9a1d2cb0d5a7 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:15:01.640935 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-bfc0e7f5-7bf7-4b7e-a070-9a1d2cb0d5a7 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:15:01.642321 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-bfc0e7f5-7bf7-4b7e-a070-9a1d2cb0d5a7 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7" status: 200 len: 1809 microversion: 2.20 time: 0.152591 Oct 17 03:15:01.642896 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 275/516] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 03:15:01 2022] GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7 => generated 1809 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:15:02.333319 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-4733692e-78a7-42c3-88b1-d8ab5c7d4e59 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:15:02.333921 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-4733692e-78a7-42c3-88b1-d8ab5c7d4e59 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] [instance: 5545b41c-d358-4568-a79c-da1f0c2e1700] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:15:02.340786 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-4733692e-78a7-42c3-88b1-d8ab5c7d4e59 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:15:02.341265 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-4733692e-78a7-42c3-88b1-d8ab5c7d4e59 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:15:02.341692 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-4733692e-78a7-42c3-88b1-d8ab5c7d4e59 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:15:02.342373 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-4733692e-78a7-42c3-88b1-d8ab5c7d4e59 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:15:02.342816 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-4733692e-78a7-42c3-88b1-d8ab5c7d4e59 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:15:02.343258 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-4733692e-78a7-42c3-88b1-d8ab5c7d4e59 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:15:02.584658 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-4733692e-78a7-42c3-88b1-d8ab5c7d4e59 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc092c3cc0b4fbc9b420b8c7916132a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d285ecc0c5343b1b4001594013cd447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:15:02.593158 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-4733692e-78a7-42c3-88b1-d8ab5c7d4e59 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] 10.222.0.27 "GET /compute/v2.1/servers/5545b41c-d358-4568-a79c-da1f0c2e1700" status: 200 len: 1318 microversion: 2.1 time: 0.263602 Oct 17 03:15:02.607378 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 242/517] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:15:02 2022] GET /compute/v2.1/servers/5545b41c-d358-4568-a79c-da1f0c2e1700 => generated 1318 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:15:02.669245 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-4d9fa781-6ac2-4209-bef2-483a2081a108 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:15:02.669844 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-4d9fa781-6ac2-4209-bef2-483a2081a108 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 603ee2bf-bedf-4688-ac0a-77a2a50f33d7] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:15:02.676491 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-4d9fa781-6ac2-4209-bef2-483a2081a108 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:15:02.676971 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-4d9fa781-6ac2-4209-bef2-483a2081a108 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:15:02.677400 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-4d9fa781-6ac2-4209-bef2-483a2081a108 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:15:02.678094 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-4d9fa781-6ac2-4209-bef2-483a2081a108 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:15:02.679398 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-4d9fa781-6ac2-4209-bef2-483a2081a108 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:15:02.679881 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-4d9fa781-6ac2-4209-bef2-483a2081a108 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:15:02.814284 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-4d9fa781-6ac2-4209-bef2-483a2081a108 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:15:02.823771 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-4d9fa781-6ac2-4209-bef2-483a2081a108 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:15:02.825237 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-4d9fa781-6ac2-4209-bef2-483a2081a108 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:15:02.826404 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-4d9fa781-6ac2-4209-bef2-483a2081a108 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7" status: 200 len: 1809 microversion: 2.20 time: 0.161075 Oct 17 03:15:02.830900 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 276/518] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 03:15:02 2022] GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7 => generated 1809 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:15:03.617342 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-5816144e-c7eb-4a44-8ca6-fa3383b54512 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:15:03.617956 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-5816144e-c7eb-4a44-8ca6-fa3383b54512 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] [instance: 5545b41c-d358-4568-a79c-da1f0c2e1700] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:15:03.626918 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-5816144e-c7eb-4a44-8ca6-fa3383b54512 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:15:03.627556 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-5816144e-c7eb-4a44-8ca6-fa3383b54512 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:15:03.628110 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-5816144e-c7eb-4a44-8ca6-fa3383b54512 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:15:03.628875 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-5816144e-c7eb-4a44-8ca6-fa3383b54512 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:15:03.629402 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-5816144e-c7eb-4a44-8ca6-fa3383b54512 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:15:03.629832 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-5816144e-c7eb-4a44-8ca6-fa3383b54512 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:15:03.765496 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-5816144e-c7eb-4a44-8ca6-fa3383b54512 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc092c3cc0b4fbc9b420b8c7916132a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d285ecc0c5343b1b4001594013cd447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:15:03.773180 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-5816144e-c7eb-4a44-8ca6-fa3383b54512 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] 10.222.0.27 "GET /compute/v2.1/servers/5545b41c-d358-4568-a79c-da1f0c2e1700" status: 200 len: 1318 microversion: 2.1 time: 0.160421 Oct 17 03:15:03.773742 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 243/519] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:15:03 2022] GET /compute/v2.1/servers/5545b41c-d358-4568-a79c-da1f0c2e1700 => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:15:03.853188 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-568c53e3-cddf-469e-9c85-c8a6d01f2681 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:15:03.853797 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-568c53e3-cddf-469e-9c85-c8a6d01f2681 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 603ee2bf-bedf-4688-ac0a-77a2a50f33d7] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:15:03.860316 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-568c53e3-cddf-469e-9c85-c8a6d01f2681 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:15:03.860797 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-568c53e3-cddf-469e-9c85-c8a6d01f2681 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:15:03.861232 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-568c53e3-cddf-469e-9c85-c8a6d01f2681 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:15:03.861974 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-568c53e3-cddf-469e-9c85-c8a6d01f2681 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:15:03.862444 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-568c53e3-cddf-469e-9c85-c8a6d01f2681 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:15:03.862856 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-568c53e3-cddf-469e-9c85-c8a6d01f2681 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:15:04.000678 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-568c53e3-cddf-469e-9c85-c8a6d01f2681 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:15:04.009200 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-568c53e3-cddf-469e-9c85-c8a6d01f2681 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:15:04.010627 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-568c53e3-cddf-469e-9c85-c8a6d01f2681 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:15:04.011800 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-568c53e3-cddf-469e-9c85-c8a6d01f2681 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7" status: 200 len: 1809 microversion: 2.20 time: 0.163143 Oct 17 03:15:04.012386 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 277/520] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 03:15:03 2022] GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7 => generated 1809 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:15:04.427912 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [req-39e427e3-2c1f-46ee-8913-0e5295d697bd req-c307616d-c36d-4ce6-959e-cd22b01296e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5545b41c-d358-4568-a79c-da1f0c2e1700", "name": "network-vif-plugged", "status": "completed", "tag": "cb27a482-79a3-49f6-be43-6876d0f79519"}]} {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:15:04.437957 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [req-39e427e3-2c1f-46ee-8913-0e5295d697bd req-c307616d-c36d-4ce6-959e-cd22b01296e5 service nova] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:15:04.438427 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [req-39e427e3-2c1f-46ee-8913-0e5295d697bd req-c307616d-c36d-4ce6-959e-cd22b01296e5 service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:15:04.438880 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [req-39e427e3-2c1f-46ee-8913-0e5295d697bd req-c307616d-c36d-4ce6-959e-cd22b01296e5 service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:15:04.451638 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.compute.server_external_events [req-39e427e3-2c1f-46ee-8913-0e5295d697bd req-c307616d-c36d-4ce6-959e-cd22b01296e5 service nova] Creating event network-vif-plugged:cb27a482-79a3-49f6-be43-6876d0f79519 for instance 5545b41c-d358-4568-a79c-da1f0c2e1700 on hv-cinder-84697 Oct 17 03:15:04.456716 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [req-39e427e3-2c1f-46ee-8913-0e5295d697bd req-c307616d-c36d-4ce6-959e-cd22b01296e5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032525 Oct 17 03:15:04.457318 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 244/521] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 03:15:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:15:04.797530 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-af8d0e4f-296e-4ffa-9a77-afecc132e75b tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:15:04.798364 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-af8d0e4f-296e-4ffa-9a77-afecc132e75b tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] [instance: 5545b41c-d358-4568-a79c-da1f0c2e1700] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:15:04.804669 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-af8d0e4f-296e-4ffa-9a77-afecc132e75b tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:15:04.805202 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-af8d0e4f-296e-4ffa-9a77-afecc132e75b tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:15:04.805671 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-af8d0e4f-296e-4ffa-9a77-afecc132e75b tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:15:04.806663 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-af8d0e4f-296e-4ffa-9a77-afecc132e75b tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:15:04.807338 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-af8d0e4f-296e-4ffa-9a77-afecc132e75b tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:15:04.807983 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-af8d0e4f-296e-4ffa-9a77-afecc132e75b tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:15:04.874893 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG dbcounter [-] [118886] Writing DB stats nova_cell0:SELECT=2 {{(pid=118886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:15:04.884358 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG dbcounter [-] [118886] Writing DB stats nova_cell0:SELECT=6 {{(pid=118886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:15:04.950038 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-af8d0e4f-296e-4ffa-9a77-afecc132e75b tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc092c3cc0b4fbc9b420b8c7916132a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d285ecc0c5343b1b4001594013cd447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:15:04.957670 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-af8d0e4f-296e-4ffa-9a77-afecc132e75b tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] 10.222.0.27 "GET /compute/v2.1/servers/5545b41c-d358-4568-a79c-da1f0c2e1700" status: 200 len: 1318 microversion: 2.1 time: 0.165177 Oct 17 03:15:04.958229 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 278/522] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:15:04 2022] GET /compute/v2.1/servers/5545b41c-d358-4568-a79c-da1f0c2e1700 => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:15:05.035231 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG dbcounter [-] [118887] Writing DB stats nova_cell0:SELECT=2 {{(pid=118887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:15:05.040253 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-17eac70b-0cc3-4328-abb1-ea5a6275e062 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:15:05.040973 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-17eac70b-0cc3-4328-abb1-ea5a6275e062 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 603ee2bf-bedf-4688-ac0a-77a2a50f33d7] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:15:05.047721 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-17eac70b-0cc3-4328-abb1-ea5a6275e062 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:15:05.048224 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-17eac70b-0cc3-4328-abb1-ea5a6275e062 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:15:05.048660 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-17eac70b-0cc3-4328-abb1-ea5a6275e062 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:15:05.049349 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-17eac70b-0cc3-4328-abb1-ea5a6275e062 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:15:05.049807 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-17eac70b-0cc3-4328-abb1-ea5a6275e062 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:15:05.050232 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-17eac70b-0cc3-4328-abb1-ea5a6275e062 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:15:05.183937 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-17eac70b-0cc3-4328-abb1-ea5a6275e062 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:15:05.192652 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-17eac70b-0cc3-4328-abb1-ea5a6275e062 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:15:05.194136 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-17eac70b-0cc3-4328-abb1-ea5a6275e062 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:15:05.195309 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-17eac70b-0cc3-4328-abb1-ea5a6275e062 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7" status: 200 len: 1809 microversion: 2.20 time: 0.161624 Oct 17 03:15:05.195861 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 245/523] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 03:15:05 2022] GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7 => generated 1809 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:15:05.981493 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-0acb05f0-51a4-48ad-ba79-c4b35196d940 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:15:05.982096 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-0acb05f0-51a4-48ad-ba79-c4b35196d940 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] [instance: 5545b41c-d358-4568-a79c-da1f0c2e1700] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:15:05.984451 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG dbcounter [-] [118886] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=118886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:15:05.990355 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-0acb05f0-51a4-48ad-ba79-c4b35196d940 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:15:05.991339 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-0acb05f0-51a4-48ad-ba79-c4b35196d940 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:15:05.992258 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-0acb05f0-51a4-48ad-ba79-c4b35196d940 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:15:05.992960 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-0acb05f0-51a4-48ad-ba79-c4b35196d940 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:15:05.993412 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-0acb05f0-51a4-48ad-ba79-c4b35196d940 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:15:05.993831 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-0acb05f0-51a4-48ad-ba79-c4b35196d940 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:15:06.137220 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-0acb05f0-51a4-48ad-ba79-c4b35196d940 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc092c3cc0b4fbc9b420b8c7916132a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d285ecc0c5343b1b4001594013cd447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:15:06.145910 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-0acb05f0-51a4-48ad-ba79-c4b35196d940 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] 10.222.0.27 "GET /compute/v2.1/servers/5545b41c-d358-4568-a79c-da1f0c2e1700" status: 200 len: 1318 microversion: 2.1 time: 0.167874 Oct 17 03:15:06.147291 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 279/524] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:15:05 2022] GET /compute/v2.1/servers/5545b41c-d358-4568-a79c-da1f0c2e1700 => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:15:06.223684 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-d20ab50f-1f93-4bdd-81be-2dc047459e1b tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:15:06.225780 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-d20ab50f-1f93-4bdd-81be-2dc047459e1b tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 603ee2bf-bedf-4688-ac0a-77a2a50f33d7] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:15:06.233304 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-d20ab50f-1f93-4bdd-81be-2dc047459e1b tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:15:06.234130 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-d20ab50f-1f93-4bdd-81be-2dc047459e1b tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:15:06.234743 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-d20ab50f-1f93-4bdd-81be-2dc047459e1b tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:15:06.236473 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-d20ab50f-1f93-4bdd-81be-2dc047459e1b tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:15:06.237462 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-d20ab50f-1f93-4bdd-81be-2dc047459e1b tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:15:06.238042 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-d20ab50f-1f93-4bdd-81be-2dc047459e1b tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:15:06.429110 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-d20ab50f-1f93-4bdd-81be-2dc047459e1b tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:15:06.440168 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-d20ab50f-1f93-4bdd-81be-2dc047459e1b tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:15:06.441856 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-d20ab50f-1f93-4bdd-81be-2dc047459e1b tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:15:06.443213 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-d20ab50f-1f93-4bdd-81be-2dc047459e1b tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7" status: 200 len: 1809 microversion: 2.20 time: 0.225775 Oct 17 03:15:06.443767 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 246/525] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 03:15:06 2022] GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7 => generated 1809 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:15:06.487547 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [req-86eef09c-122a-4d4c-a115-4b21f4189684 req-48cf4f6b-106e-470f-a12a-2c930c0d4796 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "603ee2bf-bedf-4688-ac0a-77a2a50f33d7", "name": "network-vif-plugged", "status": "completed", "tag": "faf2315a-88ad-4367-997b-65c1cf0209ee"}]} {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:15:06.497206 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [req-86eef09c-122a-4d4c-a115-4b21f4189684 req-48cf4f6b-106e-470f-a12a-2c930c0d4796 service nova] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:15:06.497676 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [req-86eef09c-122a-4d4c-a115-4b21f4189684 req-48cf4f6b-106e-470f-a12a-2c930c0d4796 service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:15:06.498096 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [req-86eef09c-122a-4d4c-a115-4b21f4189684 req-48cf4f6b-106e-470f-a12a-2c930c0d4796 service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:15:06.501805 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG dbcounter [-] [118886] Writing DB stats nova_cell1:SELECT=100 {{(pid=118886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:15:06.515397 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.compute.server_external_events [req-86eef09c-122a-4d4c-a115-4b21f4189684 req-48cf4f6b-106e-470f-a12a-2c930c0d4796 service nova] Creating event network-vif-plugged:faf2315a-88ad-4367-997b-65c1cf0209ee for instance 603ee2bf-bedf-4688-ac0a-77a2a50f33d7 on hv-cinder-84697 Oct 17 03:15:06.521309 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [req-86eef09c-122a-4d4c-a115-4b21f4189684 req-48cf4f6b-106e-470f-a12a-2c930c0d4796 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037456 Oct 17 03:15:06.522963 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 280/526] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 03:15:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:15:07.169437 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-f77b2cba-b0d8-49da-82dd-549d8b2c6c84 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:15:07.170045 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-f77b2cba-b0d8-49da-82dd-549d8b2c6c84 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] [instance: 5545b41c-d358-4568-a79c-da1f0c2e1700] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:15:07.175927 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-f77b2cba-b0d8-49da-82dd-549d8b2c6c84 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:15:07.176405 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-f77b2cba-b0d8-49da-82dd-549d8b2c6c84 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:15:07.176836 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-f77b2cba-b0d8-49da-82dd-549d8b2c6c84 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:15:07.177523 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-f77b2cba-b0d8-49da-82dd-549d8b2c6c84 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:15:07.177973 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-f77b2cba-b0d8-49da-82dd-549d8b2c6c84 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:15:07.178974 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-f77b2cba-b0d8-49da-82dd-549d8b2c6c84 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:15:07.306253 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-f77b2cba-b0d8-49da-82dd-549d8b2c6c84 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc092c3cc0b4fbc9b420b8c7916132a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d285ecc0c5343b1b4001594013cd447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:15:07.314018 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-f77b2cba-b0d8-49da-82dd-549d8b2c6c84 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] 10.222.0.27 "GET /compute/v2.1/servers/5545b41c-d358-4568-a79c-da1f0c2e1700" status: 200 len: 1506 microversion: 2.1 time: 0.148421 Oct 17 03:15:07.314566 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 247/527] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:15:07 2022] GET /compute/v2.1/servers/5545b41c-d358-4568-a79c-da1f0c2e1700 => generated 1506 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:15:07.337373 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-f2d7ae02-76a2-4817-b6e7-cf111e47a4c2 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "46615c3f-c373-440b-830a-50ba306e3feb", "device": "/dev/sdb"}} {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:15:07.340370 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-f2d7ae02-76a2-4817-b6e7-cf111e47a4c2 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] [instance: 5545b41c-d358-4568-a79c-da1f0c2e1700] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:15:07.347200 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-f2d7ae02-76a2-4817-b6e7-cf111e47a4c2 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:15:07.347673 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-f2d7ae02-76a2-4817-b6e7-cf111e47a4c2 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:15:07.348100 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-f2d7ae02-76a2-4817-b6e7-cf111e47a4c2 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:15:07.348779 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-f2d7ae02-76a2-4817-b6e7-cf111e47a4c2 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:15:07.349225 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-f2d7ae02-76a2-4817-b6e7-cf111e47a4c2 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:15:07.349642 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-f2d7ae02-76a2-4817-b6e7-cf111e47a4c2 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:15:07.469510 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-a087666d-c122-48df-9c55-d0777e40b880 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:15:07.470110 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-a087666d-c122-48df-9c55-d0777e40b880 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 603ee2bf-bedf-4688-ac0a-77a2a50f33d7] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:15:07.476555 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-a087666d-c122-48df-9c55-d0777e40b880 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:15:07.477044 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-a087666d-c122-48df-9c55-d0777e40b880 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:15:07.477483 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-a087666d-c122-48df-9c55-d0777e40b880 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:15:07.478182 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-a087666d-c122-48df-9c55-d0777e40b880 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:15:07.478638 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-a087666d-c122-48df-9c55-d0777e40b880 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:15:07.479119 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-a087666d-c122-48df-9c55-d0777e40b880 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:15:07.596066 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-f2d7ae02-76a2-4817-b6e7-cf111e47a4c2 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] 10.222.0.27 "POST /compute/v2.1/servers/5545b41c-d358-4568-a79c-da1f0c2e1700/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.262950 Oct 17 03:15:07.596776 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 281/528] 10.222.0.27 () {60 vars in 1323 bytes} [Mon Oct 17 03:15:07 2022] POST /compute/v2.1/servers/5545b41c-d358-4568-a79c-da1f0c2e1700/os-volume_attachments => generated 194 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:15:07.619497 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-a087666d-c122-48df-9c55-d0777e40b880 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:15:07.628625 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-a087666d-c122-48df-9c55-d0777e40b880 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:15:07.630106 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-a087666d-c122-48df-9c55-d0777e40b880 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:15:07.631362 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-a087666d-c122-48df-9c55-d0777e40b880 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7" status: 200 len: 1809 microversion: 2.20 time: 0.165791 Oct 17 03:15:07.632840 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 248/529] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 03:15:07 2022] GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7 => generated 1809 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 03:15:08.660083 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-5cc00f8b-d3cc-4e87-aaf6-cdbcb9caaea3 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:15:08.660777 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-5cc00f8b-d3cc-4e87-aaf6-cdbcb9caaea3 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 603ee2bf-bedf-4688-ac0a-77a2a50f33d7] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:15:08.667735 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-5cc00f8b-d3cc-4e87-aaf6-cdbcb9caaea3 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:15:08.668208 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-5cc00f8b-d3cc-4e87-aaf6-cdbcb9caaea3 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:15:08.668610 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-5cc00f8b-d3cc-4e87-aaf6-cdbcb9caaea3 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:15:08.669309 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-5cc00f8b-d3cc-4e87-aaf6-cdbcb9caaea3 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:15:08.669756 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-5cc00f8b-d3cc-4e87-aaf6-cdbcb9caaea3 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:15:08.670181 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-5cc00f8b-d3cc-4e87-aaf6-cdbcb9caaea3 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:15:08.804021 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-5cc00f8b-d3cc-4e87-aaf6-cdbcb9caaea3 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:15:08.812615 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-5cc00f8b-d3cc-4e87-aaf6-cdbcb9caaea3 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:15:08.814055 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-5cc00f8b-d3cc-4e87-aaf6-cdbcb9caaea3 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:15:08.815245 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-5cc00f8b-d3cc-4e87-aaf6-cdbcb9caaea3 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7" status: 200 len: 1809 microversion: 2.20 time: 0.160547 Oct 17 03:15:08.815797 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 282/530] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 03:15:08 2022] GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7 => generated 1809 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:15:09.840065 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-c1cec8c6-3372-45fd-af9e-36969cb88dde tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:15:09.840675 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-c1cec8c6-3372-45fd-af9e-36969cb88dde tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 603ee2bf-bedf-4688-ac0a-77a2a50f33d7] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:15:09.847289 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-c1cec8c6-3372-45fd-af9e-36969cb88dde tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:15:09.847776 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-c1cec8c6-3372-45fd-af9e-36969cb88dde tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:15:09.848213 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-c1cec8c6-3372-45fd-af9e-36969cb88dde tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:15:09.848907 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-c1cec8c6-3372-45fd-af9e-36969cb88dde tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:15:09.849398 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-c1cec8c6-3372-45fd-af9e-36969cb88dde tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:15:09.849823 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-c1cec8c6-3372-45fd-af9e-36969cb88dde tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:15:09.978688 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-c1cec8c6-3372-45fd-af9e-36969cb88dde tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:15:09.982150 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG dbcounter [-] [118887] Writing DB stats nova_cell1:SELECT=100 {{(pid=118887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:15:09.988304 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-c1cec8c6-3372-45fd-af9e-36969cb88dde tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:15:09.989732 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-c1cec8c6-3372-45fd-af9e-36969cb88dde tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:15:09.991539 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-c1cec8c6-3372-45fd-af9e-36969cb88dde tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7" status: 200 len: 1796 microversion: 2.20 time: 0.154764 Oct 17 03:15:09.992096 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 249/531] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 03:15:09 2022] GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7 => generated 1796 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:15:23.768669 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-fa469ae8-d16d-4327-bbde-e1f9e28f6ec1 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:15:23.769204 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-fa469ae8-d16d-4327-bbde-e1f9e28f6ec1 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] [instance: 7b220b35-d9ac-48e4-b898-3d4f6c7be835] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:15:23.771857 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG dbcounter [-] [118886] Writing DB stats nova_api:SELECT=7 {{(pid=118886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:15:23.772711 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG dbcounter [-] [118886] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:15:23.779961 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-fa469ae8-d16d-4327-bbde-e1f9e28f6ec1 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:15:23.780445 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-fa469ae8-d16d-4327-bbde-e1f9e28f6ec1 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:15:23.780882 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-fa469ae8-d16d-4327-bbde-e1f9e28f6ec1 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:15:23.781836 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-fa469ae8-d16d-4327-bbde-e1f9e28f6ec1 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:15:23.782293 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-fa469ae8-d16d-4327-bbde-e1f9e28f6ec1 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:15:23.782726 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-fa469ae8-d16d-4327-bbde-e1f9e28f6ec1 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:15:23.932753 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.objects.instance [None req-fa469ae8-d16d-4327-bbde-e1f9e28f6ec1 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lazy-loading 'services' on Instance uuid 7b220b35-d9ac-48e4-b898-3d4f6c7be835 {{(pid=118886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 03:15:24.058540 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-fa469ae8-d16d-4327-bbde-e1f9e28f6ec1 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] 10.222.0.27 "DELETE /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835/os-volume_attachments/a623ca03-fc4b-4f8d-a135-b53c4919cf01" status: 202 len: 0 microversion: 2.1 time: 0.293560 Oct 17 03:15:24.059169 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 283/532] 10.222.0.27 () {58 vars in 1416 bytes} [Mon Oct 17 03:15:23 2022] DELETE /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835/os-volume_attachments/a623ca03-fc4b-4f8d-a135-b53c4919cf01 => generated 0 bytes in 295 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 03:15:25.182603 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-60410749-06b7-41c8-845d-c79b3481d15e tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:15:25.185336 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG dbcounter [-] [118887] Writing DB stats nova_api:SELECT=59 {{(pid=118887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:15:25.190890 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-60410749-06b7-41c8-845d-c79b3481d15e tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:15:25.191360 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-60410749-06b7-41c8-845d-c79b3481d15e tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:15:25.191787 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-60410749-06b7-41c8-845d-c79b3481d15e tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:15:25.251812 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-60410749-06b7-41c8-845d-c79b3481d15e tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] [instance: 7b220b35-d9ac-48e4-b898-3d4f6c7be835] Going to try to stop instance {{(pid=118887) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 17 03:15:25.294318 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-60410749-06b7-41c8-845d-c79b3481d15e tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] 10.222.0.27 "POST /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835/action" status: 202 len: 0 microversion: 2.1 time: 0.115977 Oct 17 03:15:25.295311 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 250/533] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 03:15:25 2022] POST /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 03:15:25.305483 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-5f0d2e80-2b64-4f07-a302-0bdaf3177ef0 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:15:25.306187 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-5f0d2e80-2b64-4f07-a302-0bdaf3177ef0 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] [instance: 7b220b35-d9ac-48e4-b898-3d4f6c7be835] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:15:25.316082 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-5f0d2e80-2b64-4f07-a302-0bdaf3177ef0 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:15:25.316631 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-5f0d2e80-2b64-4f07-a302-0bdaf3177ef0 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:15:25.317093 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-5f0d2e80-2b64-4f07-a302-0bdaf3177ef0 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:15:25.317859 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-5f0d2e80-2b64-4f07-a302-0bdaf3177ef0 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:15:25.318359 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-5f0d2e80-2b64-4f07-a302-0bdaf3177ef0 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:15:25.319463 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-5f0d2e80-2b64-4f07-a302-0bdaf3177ef0 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:15:25.451833 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-5f0d2e80-2b64-4f07-a302-0bdaf3177ef0 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce25db99a7b14d0bbaca41fff80e3da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5bad80dc0d74119b2a9cd5c1935e8d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:15:25.460192 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-5f0d2e80-2b64-4f07-a302-0bdaf3177ef0 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] 10.222.0.27 "GET /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835" status: 200 len: 1679 microversion: 2.1 time: 0.160299 Oct 17 03:15:25.460754 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 284/534] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:15:25 2022] GET /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835 => generated 1679 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:15:26.484913 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-30364bfb-e130-47c1-a3b3-a83b58c0fce0 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:15:26.485637 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-30364bfb-e130-47c1-a3b3-a83b58c0fce0 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] [instance: 7b220b35-d9ac-48e4-b898-3d4f6c7be835] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:15:26.492885 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-30364bfb-e130-47c1-a3b3-a83b58c0fce0 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:15:26.493366 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-30364bfb-e130-47c1-a3b3-a83b58c0fce0 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:15:26.493817 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-30364bfb-e130-47c1-a3b3-a83b58c0fce0 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:15:26.494489 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-30364bfb-e130-47c1-a3b3-a83b58c0fce0 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:15:26.494972 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-30364bfb-e130-47c1-a3b3-a83b58c0fce0 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:15:26.495399 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-30364bfb-e130-47c1-a3b3-a83b58c0fce0 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:15:26.621373 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-30364bfb-e130-47c1-a3b3-a83b58c0fce0 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce25db99a7b14d0bbaca41fff80e3da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5bad80dc0d74119b2a9cd5c1935e8d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:15:26.629297 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-30364bfb-e130-47c1-a3b3-a83b58c0fce0 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] 10.222.0.27 "GET /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835" status: 200 len: 1679 microversion: 2.1 time: 0.148583 Oct 17 03:15:26.629866 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 251/535] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:15:26 2022] GET /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835 => generated 1679 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:15:27.653258 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-8b8a30a4-228f-44c8-baec-2ea3a221fb8b tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:15:27.653865 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-8b8a30a4-228f-44c8-baec-2ea3a221fb8b tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] [instance: 7b220b35-d9ac-48e4-b898-3d4f6c7be835] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:15:27.660565 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-8b8a30a4-228f-44c8-baec-2ea3a221fb8b tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:15:27.661043 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-8b8a30a4-228f-44c8-baec-2ea3a221fb8b tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:15:27.661480 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-8b8a30a4-228f-44c8-baec-2ea3a221fb8b tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:15:27.662167 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-8b8a30a4-228f-44c8-baec-2ea3a221fb8b tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:15:27.662659 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-8b8a30a4-228f-44c8-baec-2ea3a221fb8b tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:15:27.663135 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-8b8a30a4-228f-44c8-baec-2ea3a221fb8b tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:15:27.788392 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-8b8a30a4-228f-44c8-baec-2ea3a221fb8b tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce25db99a7b14d0bbaca41fff80e3da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5bad80dc0d74119b2a9cd5c1935e8d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:15:27.796010 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-8b8a30a4-228f-44c8-baec-2ea3a221fb8b tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] 10.222.0.27 "GET /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835" status: 200 len: 1679 microversion: 2.1 time: 0.146736 Oct 17 03:15:27.796576 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 285/536] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:15:27 2022] GET /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835 => generated 1679 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:15:28.031950 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-10f0a909-2371-4d88-91d3-3a360e0b3d77 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:15:28.032448 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-10f0a909-2371-4d88-91d3-3a360e0b3d77 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] [instance: 5545b41c-d358-4568-a79c-da1f0c2e1700] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:15:28.039398 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-10f0a909-2371-4d88-91d3-3a360e0b3d77 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:15:28.039883 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-10f0a909-2371-4d88-91d3-3a360e0b3d77 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:15:28.040328 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-10f0a909-2371-4d88-91d3-3a360e0b3d77 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:15:28.041019 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-10f0a909-2371-4d88-91d3-3a360e0b3d77 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:15:28.041493 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-10f0a909-2371-4d88-91d3-3a360e0b3d77 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:15:28.041923 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-10f0a909-2371-4d88-91d3-3a360e0b3d77 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:15:28.121418 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.objects.instance [None req-10f0a909-2371-4d88-91d3-3a360e0b3d77 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Lazy-loading 'services' on Instance uuid 5545b41c-d358-4568-a79c-da1f0c2e1700 {{(pid=118887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 03:15:28.192510 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-10f0a909-2371-4d88-91d3-3a360e0b3d77 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] 10.222.0.27 "DELETE /compute/v2.1/servers/5545b41c-d358-4568-a79c-da1f0c2e1700/os-volume_attachments/46615c3f-c373-440b-830a-50ba306e3feb" status: 202 len: 0 microversion: 2.1 time: 0.164588 Oct 17 03:15:28.193088 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 252/537] 10.222.0.27 () {58 vars in 1416 bytes} [Mon Oct 17 03:15:28 2022] DELETE /compute/v2.1/servers/5545b41c-d358-4568-a79c-da1f0c2e1700/os-volume_attachments/46615c3f-c373-440b-830a-50ba306e3feb => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 03:15:28.820695 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-574268a1-30e8-4e8b-9610-2a7e9e862619 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:15:28.821297 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-574268a1-30e8-4e8b-9610-2a7e9e862619 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] [instance: 7b220b35-d9ac-48e4-b898-3d4f6c7be835] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:15:28.827710 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-574268a1-30e8-4e8b-9610-2a7e9e862619 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:15:28.828190 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-574268a1-30e8-4e8b-9610-2a7e9e862619 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:15:28.828623 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-574268a1-30e8-4e8b-9610-2a7e9e862619 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:15:28.829306 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-574268a1-30e8-4e8b-9610-2a7e9e862619 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:15:28.829754 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-574268a1-30e8-4e8b-9610-2a7e9e862619 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:15:28.830175 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-574268a1-30e8-4e8b-9610-2a7e9e862619 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:15:28.962471 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-574268a1-30e8-4e8b-9610-2a7e9e862619 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce25db99a7b14d0bbaca41fff80e3da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5bad80dc0d74119b2a9cd5c1935e8d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:15:28.971674 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-574268a1-30e8-4e8b-9610-2a7e9e862619 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] 10.222.0.27 "GET /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835" status: 200 len: 1679 microversion: 2.1 time: 0.155507 Oct 17 03:15:28.972393 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 286/538] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:15:28 2022] GET /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835 => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:15:29.316574 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-821e4bfa-12a8-4149-a443-0eeed9572504 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:15:29.317158 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-821e4bfa-12a8-4149-a443-0eeed9572504 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] [instance: 5545b41c-d358-4568-a79c-da1f0c2e1700] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:15:29.324310 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-821e4bfa-12a8-4149-a443-0eeed9572504 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:15:29.324800 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-821e4bfa-12a8-4149-a443-0eeed9572504 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:15:29.325239 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-821e4bfa-12a8-4149-a443-0eeed9572504 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:15:29.325931 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-821e4bfa-12a8-4149-a443-0eeed9572504 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:15:29.326391 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-821e4bfa-12a8-4149-a443-0eeed9572504 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:15:29.326819 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-821e4bfa-12a8-4149-a443-0eeed9572504 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:15:29.354883 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-821e4bfa-12a8-4149-a443-0eeed9572504 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] [instance: 5545b41c-d358-4568-a79c-da1f0c2e1700] Going to try to terminate instance {{(pid=118887) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 03:15:29.429598 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-821e4bfa-12a8-4149-a443-0eeed9572504 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] 10.222.0.27 "DELETE /compute/v2.1/servers/5545b41c-d358-4568-a79c-da1f0c2e1700" status: 204 len: 0 microversion: 2.1 time: 0.117291 Oct 17 03:15:29.430276 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 253/539] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 03:15:29 2022] DELETE /compute/v2.1/servers/5545b41c-d358-4568-a79c-da1f0c2e1700 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 03:15:29.439019 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-c20dab5a-6929-4baa-8cfc-5c3df18ecac4 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:15:29.439623 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-c20dab5a-6929-4baa-8cfc-5c3df18ecac4 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] [instance: 5545b41c-d358-4568-a79c-da1f0c2e1700] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:15:29.446179 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-c20dab5a-6929-4baa-8cfc-5c3df18ecac4 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:15:29.446653 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-c20dab5a-6929-4baa-8cfc-5c3df18ecac4 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:15:29.447146 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-c20dab5a-6929-4baa-8cfc-5c3df18ecac4 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:15:29.447853 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-c20dab5a-6929-4baa-8cfc-5c3df18ecac4 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:15:29.448314 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-c20dab5a-6929-4baa-8cfc-5c3df18ecac4 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:15:29.448738 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-c20dab5a-6929-4baa-8cfc-5c3df18ecac4 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:15:29.575658 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-c20dab5a-6929-4baa-8cfc-5c3df18ecac4 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc092c3cc0b4fbc9b420b8c7916132a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d285ecc0c5343b1b4001594013cd447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:15:29.583204 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-c20dab5a-6929-4baa-8cfc-5c3df18ecac4 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] 10.222.0.27 "GET /compute/v2.1/servers/5545b41c-d358-4568-a79c-da1f0c2e1700" status: 200 len: 1512 microversion: 2.1 time: 0.147985 Oct 17 03:15:29.583759 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 287/540] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:15:29 2022] GET /compute/v2.1/servers/5545b41c-d358-4568-a79c-da1f0c2e1700 => generated 1512 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:15:29.996994 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-8b3be203-35fb-4545-984a-cb631de709c7 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:15:29.997675 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-8b3be203-35fb-4545-984a-cb631de709c7 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] [instance: 7b220b35-d9ac-48e4-b898-3d4f6c7be835] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:15:30.003520 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-8b3be203-35fb-4545-984a-cb631de709c7 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:15:30.003992 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-8b3be203-35fb-4545-984a-cb631de709c7 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:15:30.004420 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-8b3be203-35fb-4545-984a-cb631de709c7 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:15:30.005121 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-8b3be203-35fb-4545-984a-cb631de709c7 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:15:30.005565 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-8b3be203-35fb-4545-984a-cb631de709c7 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:15:30.005979 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-8b3be203-35fb-4545-984a-cb631de709c7 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:15:30.135782 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-8b3be203-35fb-4545-984a-cb631de709c7 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce25db99a7b14d0bbaca41fff80e3da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5bad80dc0d74119b2a9cd5c1935e8d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:15:30.143380 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-8b3be203-35fb-4545-984a-cb631de709c7 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] 10.222.0.27 "GET /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835" status: 200 len: 1679 microversion: 2.1 time: 0.150658 Oct 17 03:15:30.143934 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 254/541] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:15:29 2022] GET /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835 => generated 1679 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:15:30.607057 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-3690efb7-4767-411b-b338-2e35e9672ad4 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:15:30.607670 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-3690efb7-4767-411b-b338-2e35e9672ad4 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] [instance: 5545b41c-d358-4568-a79c-da1f0c2e1700] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:15:30.614089 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-3690efb7-4767-411b-b338-2e35e9672ad4 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:15:30.614560 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-3690efb7-4767-411b-b338-2e35e9672ad4 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:15:30.615036 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-3690efb7-4767-411b-b338-2e35e9672ad4 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:15:30.616338 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-3690efb7-4767-411b-b338-2e35e9672ad4 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:15:30.616793 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-3690efb7-4767-411b-b338-2e35e9672ad4 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:15:30.617217 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-3690efb7-4767-411b-b338-2e35e9672ad4 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:15:30.751234 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-3690efb7-4767-411b-b338-2e35e9672ad4 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc092c3cc0b4fbc9b420b8c7916132a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d285ecc0c5343b1b4001594013cd447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:15:30.759807 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-3690efb7-4767-411b-b338-2e35e9672ad4 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] 10.222.0.27 "GET /compute/v2.1/servers/5545b41c-d358-4568-a79c-da1f0c2e1700" status: 200 len: 1512 microversion: 2.1 time: 0.156793 Oct 17 03:15:30.760378 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 288/542] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:15:30 2022] GET /compute/v2.1/servers/5545b41c-d358-4568-a79c-da1f0c2e1700 => generated 1512 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:15:31.166826 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-c4c5e315-7159-4170-a923-9c6abd83d6bf tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:15:31.167459 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-c4c5e315-7159-4170-a923-9c6abd83d6bf tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] [instance: 7b220b35-d9ac-48e4-b898-3d4f6c7be835] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:15:31.173888 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-c4c5e315-7159-4170-a923-9c6abd83d6bf tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:15:31.174371 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-c4c5e315-7159-4170-a923-9c6abd83d6bf tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:15:31.174807 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-c4c5e315-7159-4170-a923-9c6abd83d6bf tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:15:31.175519 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-c4c5e315-7159-4170-a923-9c6abd83d6bf tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:15:31.175975 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-c4c5e315-7159-4170-a923-9c6abd83d6bf tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:15:31.176399 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-c4c5e315-7159-4170-a923-9c6abd83d6bf tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:15:31.304560 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-c4c5e315-7159-4170-a923-9c6abd83d6bf tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce25db99a7b14d0bbaca41fff80e3da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5bad80dc0d74119b2a9cd5c1935e8d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:15:31.312230 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-c4c5e315-7159-4170-a923-9c6abd83d6bf tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] 10.222.0.27 "GET /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835" status: 200 len: 1679 microversion: 2.1 time: 0.149789 Oct 17 03:15:31.312790 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 255/543] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:15:31 2022] GET /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835 => generated 1679 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:15:31.781850 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-dd2a0228-b8c0-4887-8818-a5e2de2128f3 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:15:31.782366 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-dd2a0228-b8c0-4887-8818-a5e2de2128f3 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] [instance: 5545b41c-d358-4568-a79c-da1f0c2e1700] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:15:31.789231 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-dd2a0228-b8c0-4887-8818-a5e2de2128f3 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:15:31.789709 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-dd2a0228-b8c0-4887-8818-a5e2de2128f3 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:15:31.790133 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-dd2a0228-b8c0-4887-8818-a5e2de2128f3 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:15:31.790815 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-dd2a0228-b8c0-4887-8818-a5e2de2128f3 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:15:31.791285 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-dd2a0228-b8c0-4887-8818-a5e2de2128f3 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:15:31.791699 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-dd2a0228-b8c0-4887-8818-a5e2de2128f3 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:15:31.855519 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-dd2a0228-b8c0-4887-8818-a5e2de2128f3 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc092c3cc0b4fbc9b420b8c7916132a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d285ecc0c5343b1b4001594013cd447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:15:31.864073 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-dd2a0228-b8c0-4887-8818-a5e2de2128f3 tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] 10.222.0.27 "GET /compute/v2.1/servers/5545b41c-d358-4568-a79c-da1f0c2e1700" status: 200 len: 1470 microversion: 2.1 time: 0.086228 Oct 17 03:15:31.865050 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 289/544] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:15:31 2022] GET /compute/v2.1/servers/5545b41c-d358-4568-a79c-da1f0c2e1700 => generated 1470 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:15:31.914392 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [req-e9170ed4-8a3e-4111-8a6a-2efeb38506a4 req-112eb328-6776-4ff6-9d1c-3b373c176ddd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5545b41c-d358-4568-a79c-da1f0c2e1700", "name": "network-vif-deleted", "tag": "cb27a482-79a3-49f6-be43-6876d0f79519"}]} {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:15:31.923936 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [req-e9170ed4-8a3e-4111-8a6a-2efeb38506a4 req-112eb328-6776-4ff6-9d1c-3b373c176ddd service nova] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:15:31.924413 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [req-e9170ed4-8a3e-4111-8a6a-2efeb38506a4 req-112eb328-6776-4ff6-9d1c-3b373c176ddd service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:15:31.924841 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [req-e9170ed4-8a3e-4111-8a6a-2efeb38506a4 req-112eb328-6776-4ff6-9d1c-3b373c176ddd service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:15:31.937039 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.compute.server_external_events [req-e9170ed4-8a3e-4111-8a6a-2efeb38506a4 req-112eb328-6776-4ff6-9d1c-3b373c176ddd service nova] Creating event network-vif-deleted:cb27a482-79a3-49f6-be43-6876d0f79519 for instance 5545b41c-d358-4568-a79c-da1f0c2e1700 on hv-cinder-84697 Oct 17 03:15:31.941965 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [req-e9170ed4-8a3e-4111-8a6a-2efeb38506a4 req-112eb328-6776-4ff6-9d1c-3b373c176ddd service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032253 Oct 17 03:15:31.942559 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 256/545] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 03:15:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:15:32.336087 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-869e1b2b-50e1-49f5-ab7a-f849ddf582ff tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:15:32.336723 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-869e1b2b-50e1-49f5-ab7a-f849ddf582ff tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] [instance: 7b220b35-d9ac-48e4-b898-3d4f6c7be835] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:15:32.342501 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-869e1b2b-50e1-49f5-ab7a-f849ddf582ff tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:15:32.343021 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-869e1b2b-50e1-49f5-ab7a-f849ddf582ff tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:15:32.343454 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-869e1b2b-50e1-49f5-ab7a-f849ddf582ff tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:15:32.344138 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-869e1b2b-50e1-49f5-ab7a-f849ddf582ff tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:15:32.344586 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-869e1b2b-50e1-49f5-ab7a-f849ddf582ff tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:15:32.345008 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-869e1b2b-50e1-49f5-ab7a-f849ddf582ff tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:15:32.471559 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-869e1b2b-50e1-49f5-ab7a-f849ddf582ff tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce25db99a7b14d0bbaca41fff80e3da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5bad80dc0d74119b2a9cd5c1935e8d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:15:32.479315 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-869e1b2b-50e1-49f5-ab7a-f849ddf582ff tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] 10.222.0.27 "GET /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835" status: 200 len: 1679 microversion: 2.1 time: 0.147940 Oct 17 03:15:32.479877 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 290/546] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:15:32 2022] GET /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835 => generated 1679 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:15:32.888270 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-e54006ab-6e15-433d-9f74-84272472789f tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:15:32.889069 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-e54006ab-6e15-433d-9f74-84272472789f tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] [instance: 5545b41c-d358-4568-a79c-da1f0c2e1700] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:15:32.895186 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-e54006ab-6e15-433d-9f74-84272472789f tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:15:32.895668 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-e54006ab-6e15-433d-9f74-84272472789f tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:15:32.896099 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-e54006ab-6e15-433d-9f74-84272472789f tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:15:32.896839 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-e54006ab-6e15-433d-9f74-84272472789f tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:15:32.897389 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-e54006ab-6e15-433d-9f74-84272472789f tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:15:32.897818 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-e54006ab-6e15-433d-9f74-84272472789f tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:15:32.911122 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.wsgi [None req-e54006ab-6e15-433d-9f74-84272472789f tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] HTTP exception thrown: Instance 5545b41c-d358-4568-a79c-da1f0c2e1700 could not be found. Oct 17 03:15:32.912819 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-e54006ab-6e15-433d-9f74-84272472789f tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Request method failure captured: Oct 17 03:15:32.912819 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: request: GET /compute/v2.1/servers/5545b41c-d358-4568-a79c-da1f0c2e1700 HTTP/1.1 Oct 17 03:15:32.912819 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Accept: application/json Oct 17 03:15:32.912819 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Accept-Encoding: identity Oct 17 03:15:32.912819 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Connection: close Oct 17 03:15:32.912819 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Content-Length: 0 Oct 17 03:15:32.912819 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Content-Type: application/json Oct 17 03:15:32.912819 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Host: 10.222.0.27 Oct 17 03:15:32.912819 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Openstack-System-Scope: None Oct 17 03:15:32.912819 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: User-Agent: python-urllib3/1.26.12 Oct 17 03:15:32.912819 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Auth-Token: gAAAAABjTMhEZSiNTo_1ODQwOUrYBQy-KNcLRd_m9WBoIhpr85k9UouBEhcUK_evVTDxTIunAVCU3uzMarzuNyjzEp94twr1Jnpfv5gc8nnmQkiwNJVFmP8zsdj_UWfD2WNN0Vdfyo8miyYMpFkxumfWUV6ErJ_EYgQG9jfI8yn-HaeE_nevY6U Oct 17 03:15:32.912819 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Domain-Id: None Oct 17 03:15:32.912819 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Domain-Name: None Oct 17 03:15:32.912819 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Identity-Status: Confirmed Oct 17 03:15:32.912819 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Is-Admin-Project: True Oct 17 03:15:32.912819 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Project-Domain-Id: default Oct 17 03:15:32.912819 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Project-Domain-Name: Default Oct 17 03:15:32.912819 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Project-Id: 0d285ecc0c5343b1b4001594013cd447 Oct 17 03:15:32.912819 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1412287430 Oct 17 03:15:32.912819 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Role: member,reader Oct 17 03:15:32.912819 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Roles: member,reader Oct 17 03:15:32.914468 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0d285ecc0c5343b1b4001594013cd447"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0d285ecc0c5343b1b4001594013cd447"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0d285ecc0c5343b1b4001594013cd447"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0d285ecc0c5343b1b4001594013cd447"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 17 03:15:32.914468 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Tenant: tempest-VolumesSnapshotTestJSON-1412287430 Oct 17 03:15:32.914468 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Tenant-Id: 0d285ecc0c5343b1b4001594013cd447 Oct 17 03:15:32.914468 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1412287430 Oct 17 03:15:32.914468 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-User: tempest-VolumesSnapshotTestJSON-1412287430-project Oct 17 03:15:32.914468 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-User-Domain-Id: default Oct 17 03:15:32.914468 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-User-Domain-Name: Default Oct 17 03:15:32.914468 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-User-Id: 7cc092c3cc0b4fbc9b420b8c7916132a Oct 17 03:15:32.914468 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-User-Name: tempest-VolumesSnapshotTestJSON-1412287430-project Oct 17 03:15:32.914468 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: method: > Oct 17 03:15:32.914468 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: exception: Instance 5545b41c-d358-4568-a79c-da1f0c2e1700 could not be found. Oct 17 03:15:32.914468 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: action_args: {'id': '5545b41c-d358-4568-a79c-da1f0c2e1700'} Oct 17 03:15:32.915374 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 03:15:32.915374 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:15:32.915374 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 03:15:32.915374 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 03:15:32.915374 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 03:15:32.915374 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 03:15:32.915374 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 03:15:32.915374 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 03:15:32.915374 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 03:15:32.915374 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 03:15:32.915374 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5545b41c-d358-4568-a79c-da1f0c2e1700 could not be found. Oct 17 03:15:32.915374 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Oct 17 03:15:32.915374 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:15:32.915374 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Oct 17 03:15:32.915374 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:15:32.915374 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:15:32.915374 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:15:32.915374 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 03:15:32.915374 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 03:15:32.915374 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 03:15:32.916787 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 03:15:32.916787 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 03:15:32.916787 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 03:15:32.916787 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 03:15:32.916787 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 03:15:32.916787 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 03:15:32.916787 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 03:15:32.916787 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5545b41c-d358-4568-a79c-da1f0c2e1700 could not be found. Oct 17 03:15:32.916787 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Oct 17 03:15:32.916787 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:15:32.916787 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Oct 17 03:15:32.916787 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:15:32.916787 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:15:32.916787 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:15:32.916787 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 03:15:32.916787 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 03:15:32.916787 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5545b41c-d358-4568-a79c-da1f0c2e1700 could not be found. Oct 17 03:15:32.916787 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Oct 17 03:15:32.918081 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-e54006ab-6e15-433d-9f74-84272472789f tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] Returning 404 to user: Instance 5545b41c-d358-4568-a79c-da1f0c2e1700 could not be found. {{(pid=118887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 03:15:32.918081 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-e54006ab-6e15-433d-9f74-84272472789f tempest-VolumesSnapshotTestJSON-1412287430 tempest-VolumesSnapshotTestJSON-1412287430-project] 10.222.0.27 "GET /compute/v2.1/servers/5545b41c-d358-4568-a79c-da1f0c2e1700" status: 404 len: 111 microversion: 2.1 time: 0.030571 Oct 17 03:15:32.918081 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 257/547] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:15:32 2022] GET /compute/v2.1/servers/5545b41c-d358-4568-a79c-da1f0c2e1700 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 03:15:33.501656 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-50286638-6967-4348-b586-4ec7f0529d23 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:15:33.502184 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-50286638-6967-4348-b586-4ec7f0529d23 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] [instance: 7b220b35-d9ac-48e4-b898-3d4f6c7be835] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:15:33.508761 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-50286638-6967-4348-b586-4ec7f0529d23 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:15:33.509240 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-50286638-6967-4348-b586-4ec7f0529d23 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:15:33.509669 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-50286638-6967-4348-b586-4ec7f0529d23 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:15:33.510363 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-50286638-6967-4348-b586-4ec7f0529d23 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:15:33.510803 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-50286638-6967-4348-b586-4ec7f0529d23 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:15:33.511250 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-50286638-6967-4348-b586-4ec7f0529d23 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:15:33.641727 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-50286638-6967-4348-b586-4ec7f0529d23 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce25db99a7b14d0bbaca41fff80e3da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5bad80dc0d74119b2a9cd5c1935e8d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:15:33.650082 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-50286638-6967-4348-b586-4ec7f0529d23 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] 10.222.0.27 "GET /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835" status: 200 len: 1679 microversion: 2.1 time: 0.152404 Oct 17 03:15:33.650640 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 291/548] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:15:33 2022] GET /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835 => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:15:34.674291 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-1f933d9b-0bb4-44cd-ace8-b1ea753e3be6 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:15:34.674965 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-1f933d9b-0bb4-44cd-ace8-b1ea753e3be6 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] [instance: 7b220b35-d9ac-48e4-b898-3d4f6c7be835] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:15:34.681615 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-1f933d9b-0bb4-44cd-ace8-b1ea753e3be6 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:15:34.682097 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-1f933d9b-0bb4-44cd-ace8-b1ea753e3be6 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:15:34.682531 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-1f933d9b-0bb4-44cd-ace8-b1ea753e3be6 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:15:34.683251 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-1f933d9b-0bb4-44cd-ace8-b1ea753e3be6 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:15:34.683703 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-1f933d9b-0bb4-44cd-ace8-b1ea753e3be6 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:15:34.684128 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-1f933d9b-0bb4-44cd-ace8-b1ea753e3be6 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:15:34.813277 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-1f933d9b-0bb4-44cd-ace8-b1ea753e3be6 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce25db99a7b14d0bbaca41fff80e3da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5bad80dc0d74119b2a9cd5c1935e8d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:15:34.821411 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-1f933d9b-0bb4-44cd-ace8-b1ea753e3be6 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] 10.222.0.27 "GET /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835" status: 200 len: 1679 microversion: 2.1 time: 0.151052 Oct 17 03:15:34.821970 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 258/549] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:15:34 2022] GET /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835 => generated 1679 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:15:35.845082 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-e3da1853-14cc-48f4-b06c-6d412f4406a8 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:15:35.845693 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-e3da1853-14cc-48f4-b06c-6d412f4406a8 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] [instance: 7b220b35-d9ac-48e4-b898-3d4f6c7be835] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:15:35.852885 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-e3da1853-14cc-48f4-b06c-6d412f4406a8 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:15:35.853457 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-e3da1853-14cc-48f4-b06c-6d412f4406a8 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:15:35.853920 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-e3da1853-14cc-48f4-b06c-6d412f4406a8 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:15:35.854614 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-e3da1853-14cc-48f4-b06c-6d412f4406a8 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:15:35.855108 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-e3da1853-14cc-48f4-b06c-6d412f4406a8 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:15:35.855555 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-e3da1853-14cc-48f4-b06c-6d412f4406a8 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:15:35.983264 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-e3da1853-14cc-48f4-b06c-6d412f4406a8 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce25db99a7b14d0bbaca41fff80e3da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5bad80dc0d74119b2a9cd5c1935e8d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:15:35.990838 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-e3da1853-14cc-48f4-b06c-6d412f4406a8 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] 10.222.0.27 "GET /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835" status: 200 len: 1679 microversion: 2.1 time: 0.149627 Oct 17 03:15:35.991418 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 292/550] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:15:35 2022] GET /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835 => generated 1679 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:15:37.014637 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-a2b543f3-ed54-463d-981c-e379769959be tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:15:37.015270 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-a2b543f3-ed54-463d-981c-e379769959be tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] [instance: 7b220b35-d9ac-48e4-b898-3d4f6c7be835] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:15:37.022038 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-a2b543f3-ed54-463d-981c-e379769959be tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:15:37.022512 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-a2b543f3-ed54-463d-981c-e379769959be tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:15:37.022975 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-a2b543f3-ed54-463d-981c-e379769959be tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:15:37.023658 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-a2b543f3-ed54-463d-981c-e379769959be tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:15:37.024123 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-a2b543f3-ed54-463d-981c-e379769959be tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:15:37.024529 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-a2b543f3-ed54-463d-981c-e379769959be tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:15:37.155246 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-a2b543f3-ed54-463d-981c-e379769959be tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce25db99a7b14d0bbaca41fff80e3da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5bad80dc0d74119b2a9cd5c1935e8d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:15:37.162994 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-a2b543f3-ed54-463d-981c-e379769959be tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] 10.222.0.27 "GET /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835" status: 200 len: 1679 microversion: 2.1 time: 0.152705 Oct 17 03:15:37.163546 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 259/551] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:15:37 2022] GET /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835 => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:15:38.186902 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-b639bf2a-7dd0-4ee3-8579-14c7e8131632 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:15:38.187517 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-b639bf2a-7dd0-4ee3-8579-14c7e8131632 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] [instance: 7b220b35-d9ac-48e4-b898-3d4f6c7be835] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:15:38.193881 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-b639bf2a-7dd0-4ee3-8579-14c7e8131632 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:15:38.194370 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-b639bf2a-7dd0-4ee3-8579-14c7e8131632 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:15:38.194808 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-b639bf2a-7dd0-4ee3-8579-14c7e8131632 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:15:38.195524 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-b639bf2a-7dd0-4ee3-8579-14c7e8131632 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:15:38.195981 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-b639bf2a-7dd0-4ee3-8579-14c7e8131632 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:15:38.196453 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-b639bf2a-7dd0-4ee3-8579-14c7e8131632 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:15:38.331003 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-b639bf2a-7dd0-4ee3-8579-14c7e8131632 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce25db99a7b14d0bbaca41fff80e3da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5bad80dc0d74119b2a9cd5c1935e8d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:15:38.339194 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-b639bf2a-7dd0-4ee3-8579-14c7e8131632 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] 10.222.0.27 "GET /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835" status: 200 len: 1679 microversion: 2.1 time: 0.156285 Oct 17 03:15:38.339754 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 293/552] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:15:38 2022] GET /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835 => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:15:39.362531 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-52b9fd03-6e9e-4d7a-979e-027101c1d461 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:15:39.363177 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-52b9fd03-6e9e-4d7a-979e-027101c1d461 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] [instance: 7b220b35-d9ac-48e4-b898-3d4f6c7be835] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:15:39.369906 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-52b9fd03-6e9e-4d7a-979e-027101c1d461 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:15:39.370382 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-52b9fd03-6e9e-4d7a-979e-027101c1d461 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:15:39.370812 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-52b9fd03-6e9e-4d7a-979e-027101c1d461 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:15:39.371524 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-52b9fd03-6e9e-4d7a-979e-027101c1d461 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:15:39.371978 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-52b9fd03-6e9e-4d7a-979e-027101c1d461 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:15:39.372399 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-52b9fd03-6e9e-4d7a-979e-027101c1d461 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:15:39.499479 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-52b9fd03-6e9e-4d7a-979e-027101c1d461 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce25db99a7b14d0bbaca41fff80e3da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5bad80dc0d74119b2a9cd5c1935e8d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:15:39.507161 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-52b9fd03-6e9e-4d7a-979e-027101c1d461 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] 10.222.0.27 "GET /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835" status: 200 len: 1679 microversion: 2.1 time: 0.148426 Oct 17 03:15:39.507720 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 260/553] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:15:39 2022] GET /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835 => generated 1679 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:15:40.531724 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-a92761fa-da46-42dc-a03d-f378b9760fe1 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:15:40.532354 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-a92761fa-da46-42dc-a03d-f378b9760fe1 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] [instance: 7b220b35-d9ac-48e4-b898-3d4f6c7be835] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:15:40.538989 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-a92761fa-da46-42dc-a03d-f378b9760fe1 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:15:40.539470 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-a92761fa-da46-42dc-a03d-f378b9760fe1 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:15:40.539904 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-a92761fa-da46-42dc-a03d-f378b9760fe1 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:15:40.541215 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-a92761fa-da46-42dc-a03d-f378b9760fe1 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:15:40.541663 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-a92761fa-da46-42dc-a03d-f378b9760fe1 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:15:40.542085 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-a92761fa-da46-42dc-a03d-f378b9760fe1 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:15:40.669545 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-a92761fa-da46-42dc-a03d-f378b9760fe1 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce25db99a7b14d0bbaca41fff80e3da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5bad80dc0d74119b2a9cd5c1935e8d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:15:40.677258 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-a92761fa-da46-42dc-a03d-f378b9760fe1 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] 10.222.0.27 "GET /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835" status: 200 len: 1679 microversion: 2.1 time: 0.149751 Oct 17 03:15:40.677817 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 294/554] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:15:40 2022] GET /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835 => generated 1679 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:15:41.700828 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-b733c21e-111d-471f-bbbe-45f35e85c2da tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:15:41.701402 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-b733c21e-111d-471f-bbbe-45f35e85c2da tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] [instance: 7b220b35-d9ac-48e4-b898-3d4f6c7be835] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:15:41.707941 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-b733c21e-111d-471f-bbbe-45f35e85c2da tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:15:41.708412 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-b733c21e-111d-471f-bbbe-45f35e85c2da tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:15:41.708838 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-b733c21e-111d-471f-bbbe-45f35e85c2da tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:15:41.709510 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-b733c21e-111d-471f-bbbe-45f35e85c2da tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:15:41.709958 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-b733c21e-111d-471f-bbbe-45f35e85c2da tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:15:41.710370 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-b733c21e-111d-471f-bbbe-45f35e85c2da tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:15:41.839721 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-b733c21e-111d-471f-bbbe-45f35e85c2da tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce25db99a7b14d0bbaca41fff80e3da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5bad80dc0d74119b2a9cd5c1935e8d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:15:41.847272 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-b733c21e-111d-471f-bbbe-45f35e85c2da tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] 10.222.0.27 "GET /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835" status: 200 len: 1656 microversion: 2.1 time: 0.150735 Oct 17 03:15:41.847825 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 261/555] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:15:41 2022] GET /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835 => generated 1656 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:15:41.870899 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-a52c387a-3608-4a3c-8b1e-62d00718dc3e tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:15:41.877257 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-a52c387a-3608-4a3c-8b1e-62d00718dc3e tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:15:41.877733 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-a52c387a-3608-4a3c-8b1e-62d00718dc3e tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:15:41.878156 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-a52c387a-3608-4a3c-8b1e-62d00718dc3e tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:15:41.899632 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-a52c387a-3608-4a3c-8b1e-62d00718dc3e tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] [instance: 7b220b35-d9ac-48e4-b898-3d4f6c7be835] Going to try to start instance {{(pid=118886) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 17 03:15:41.941082 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-a52c387a-3608-4a3c-8b1e-62d00718dc3e tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] 10.222.0.27 "POST /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835/action" status: 202 len: 0 microversion: 2.1 time: 0.074565 Oct 17 03:15:41.941664 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 295/556] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 03:15:41 2022] POST /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835/action => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 03:15:41.949794 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-92bd0aa5-8bdb-4642-92a9-057a64bfdf8d tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:15:41.950477 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-92bd0aa5-8bdb-4642-92a9-057a64bfdf8d tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] [instance: 7b220b35-d9ac-48e4-b898-3d4f6c7be835] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:15:41.956546 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-92bd0aa5-8bdb-4642-92a9-057a64bfdf8d tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:15:41.957130 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-92bd0aa5-8bdb-4642-92a9-057a64bfdf8d tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:15:41.957551 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-92bd0aa5-8bdb-4642-92a9-057a64bfdf8d tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:15:41.958237 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-92bd0aa5-8bdb-4642-92a9-057a64bfdf8d tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:15:41.958735 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-92bd0aa5-8bdb-4642-92a9-057a64bfdf8d tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:15:41.959179 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-92bd0aa5-8bdb-4642-92a9-057a64bfdf8d tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:15:42.089751 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-92bd0aa5-8bdb-4642-92a9-057a64bfdf8d tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce25db99a7b14d0bbaca41fff80e3da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5bad80dc0d74119b2a9cd5c1935e8d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:15:42.097518 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-92bd0aa5-8bdb-4642-92a9-057a64bfdf8d tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] 10.222.0.27 "GET /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835" status: 200 len: 1665 microversion: 2.1 time: 0.151580 Oct 17 03:15:42.098107 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 262/557] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:15:41 2022] GET /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835 => generated 1665 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:15:43.123790 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-937c52ae-e515-48ce-aedc-4e26dd315509 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:15:43.124498 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-937c52ae-e515-48ce-aedc-4e26dd315509 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] [instance: 7b220b35-d9ac-48e4-b898-3d4f6c7be835] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:15:43.130565 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-937c52ae-e515-48ce-aedc-4e26dd315509 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:15:43.131069 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-937c52ae-e515-48ce-aedc-4e26dd315509 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:15:43.131497 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-937c52ae-e515-48ce-aedc-4e26dd315509 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:15:43.132170 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-937c52ae-e515-48ce-aedc-4e26dd315509 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:15:43.132614 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-937c52ae-e515-48ce-aedc-4e26dd315509 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:15:43.133028 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-937c52ae-e515-48ce-aedc-4e26dd315509 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:15:43.263434 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-937c52ae-e515-48ce-aedc-4e26dd315509 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce25db99a7b14d0bbaca41fff80e3da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5bad80dc0d74119b2a9cd5c1935e8d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:15:43.271322 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-937c52ae-e515-48ce-aedc-4e26dd315509 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] 10.222.0.27 "GET /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835" status: 200 len: 1665 microversion: 2.1 time: 0.152919 Oct 17 03:15:43.271879 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 296/558] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:15:43 2022] GET /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835 => generated 1665 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:15:43.859583 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-82a22592-6f39-453b-8dc6-33579d5f979d tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:15:43.860363 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-82a22592-6f39-453b-8dc6-33579d5f979d tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] [instance: d834c830-cb7f-43ce-ac79-2bf168e8f664] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:15:43.869264 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-82a22592-6f39-453b-8dc6-33579d5f979d tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:15:43.869745 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-82a22592-6f39-453b-8dc6-33579d5f979d tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:15:43.870179 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-82a22592-6f39-453b-8dc6-33579d5f979d tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:15:43.870905 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-82a22592-6f39-453b-8dc6-33579d5f979d tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:15:43.871352 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-82a22592-6f39-453b-8dc6-33579d5f979d tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:15:43.871768 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-82a22592-6f39-453b-8dc6-33579d5f979d tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:15:43.895365 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-82a22592-6f39-453b-8dc6-33579d5f979d tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] 10.222.0.27 "GET /compute/v2.1/servers/d834c830-cb7f-43ce-ac79-2bf168e8f664/ips" status: 200 len: 150 microversion: 2.1 time: 0.040848 Oct 17 03:15:43.895926 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 263/559] 10.222.0.27 () {58 vars in 1248 bytes} [Mon Oct 17 03:15:43 2022] GET /compute/v2.1/servers/d834c830-cb7f-43ce-ac79-2bf168e8f664/ips => generated 150 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:15:43.908558 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-f7150310-5c43-41f9-be7c-92d2d1ae5b82 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "acc77ace-8d37-4857-8e81-f7950fb7fa51"}} {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:15:43.911014 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-f7150310-5c43-41f9-be7c-92d2d1ae5b82 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] [instance: d834c830-cb7f-43ce-ac79-2bf168e8f664] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:15:43.917187 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-f7150310-5c43-41f9-be7c-92d2d1ae5b82 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:15:43.917667 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-f7150310-5c43-41f9-be7c-92d2d1ae5b82 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:15:43.918100 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-f7150310-5c43-41f9-be7c-92d2d1ae5b82 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:15:43.918789 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-f7150310-5c43-41f9-be7c-92d2d1ae5b82 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:15:43.919274 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-f7150310-5c43-41f9-be7c-92d2d1ae5b82 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:15:43.919700 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-f7150310-5c43-41f9-be7c-92d2d1ae5b82 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:15:43.994688 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG dbcounter [-] [118886] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:15:43.999383 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.wsgi [None req-f7150310-5c43-41f9-be7c-92d2d1ae5b82 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] HTTP exception thrown: Invalid volume: volume acc77ace-8d37-4857-8e81-f7950fb7fa51 is already attached to instances: 4fc83673-1557-4eb9-b80b-825364198d8a Oct 17 03:15:44.001261 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-f7150310-5c43-41f9-be7c-92d2d1ae5b82 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Request method failure captured: Oct 17 03:15:44.001261 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: request: POST /compute/v2.1/servers/d834c830-cb7f-43ce-ac79-2bf168e8f664/os-volume_attachments HTTP/1.1 Oct 17 03:15:44.001261 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Accept: application/json Oct 17 03:15:44.001261 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Accept-Encoding: identity Oct 17 03:15:44.001261 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Connection: close Oct 17 03:15:44.001261 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Content-Length: 74 Oct 17 03:15:44.001261 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Content-Type: application/json Oct 17 03:15:44.001261 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Host: 10.222.0.27 Oct 17 03:15:44.001261 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Openstack-System-Scope: None Oct 17 03:15:44.001261 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: User-Agent: python-urllib3/1.26.12 Oct 17 03:15:44.001261 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Auth-Token: gAAAAABjTMf-SpDw6REUqxlSOIvhtlgFxCyi7gugHXw9249WtXgpgYG8a0yyM9JbvLErgztKU1aaT378mlFtg9Uhrjdru2uD9-W4FJ-CkFLSVPWuyDvIf6q3m3rDvz5qZHkGg2K6V9p96rkOt2BGqAhrNrGmStKoZpndwIVbln6Rg2eRSFSEBDA Oct 17 03:15:44.001261 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Domain-Id: None Oct 17 03:15:44.001261 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Domain-Name: None Oct 17 03:15:44.001261 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Identity-Status: Confirmed Oct 17 03:15:44.001261 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Is-Admin-Project: True Oct 17 03:15:44.001261 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Project-Domain-Id: default Oct 17 03:15:44.001261 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Project-Domain-Name: Default Oct 17 03:15:44.001261 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Project-Id: 618cf0b3507845909bb27c13460d1d6c Oct 17 03:15:44.001261 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Project-Name: tempest-AttachVolumeNegativeTest-816799241 Oct 17 03:15:44.001261 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Role: member,reader Oct 17 03:15:44.001261 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Roles: member,reader Oct 17 03:15:44.002663 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/618cf0b3507845909bb27c13460d1d6c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/618cf0b3507845909bb27c13460d1d6c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/618cf0b3507845909bb27c13460d1d6c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_618cf0b3507845909bb27c13460d1d6c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 17 03:15:44.002663 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Tenant: tempest-AttachVolumeNegativeTest-816799241 Oct 17 03:15:44.002663 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Tenant-Id: 618cf0b3507845909bb27c13460d1d6c Oct 17 03:15:44.002663 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-816799241 Oct 17 03:15:44.002663 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-User: tempest-AttachVolumeNegativeTest-816799241-project Oct 17 03:15:44.002663 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-User-Domain-Id: default Oct 17 03:15:44.002663 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-User-Domain-Name: Default Oct 17 03:15:44.002663 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-User-Id: 1c786544e8fb4e8e8c3a4990a0f36725 Oct 17 03:15:44.002663 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-User-Name: tempest-AttachVolumeNegativeTest-816799241-project Oct 17 03:15:44.002663 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Oct 17 03:15:44.002663 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: {"volumeAttachment": {"volumeId": "acc77ace-8d37-4857-8e81-f7950fb7fa51"}} Oct 17 03:15:44.002663 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: method: > Oct 17 03:15:44.003484 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: exception: Invalid volume: volume acc77ace-8d37-4857-8e81-f7950fb7fa51 is already attached to instances: 4fc83673-1557-4eb9-b80b-825364198d8a Oct 17 03:15:44.003484 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: action_args: {'server_id': 'd834c830-cb7f-43ce-ac79-2bf168e8f664', 'body': {'volumeAttachment': {'volumeId': 'acc77ace-8d37-4857-8e81-f7950fb7fa51'}}} Oct 17 03:15:44.003484 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 03:15:44.003484 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:15:44.003484 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 17 03:15:44.003484 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 17 03:15:44.003484 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 17 03:15:44.003484 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 17 03:15:44.003484 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 17 03:15:44.003484 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 17 03:15:44.003484 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 17 03:15:44.003484 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 17 03:15:44.003484 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 17 03:15:44.003484 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 17 03:15:44.003484 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume acc77ace-8d37-4857-8e81-f7950fb7fa51 is already attached to instances: 4fc83673-1557-4eb9-b80b-825364198d8a Oct 17 03:15:44.003484 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Oct 17 03:15:44.003484 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:15:44.003484 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Oct 17 03:15:44.003484 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:15:44.004847 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:15:44.004847 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:15:44.004847 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 03:15:44.004847 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 03:15:44.004847 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 03:15:44.004847 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 03:15:44.004847 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 03:15:44.004847 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 03:15:44.004847 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 03:15:44.004847 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 03:15:44.004847 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 03:15:44.004847 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 03:15:44.004847 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 17 03:15:44.004847 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 17 03:15:44.004847 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume acc77ace-8d37-4857-8e81-f7950fb7fa51 is already attached to instances: 4fc83673-1557-4eb9-b80b-825364198d8a Oct 17 03:15:44.004847 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Oct 17 03:15:44.004847 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:15:44.004847 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Oct 17 03:15:44.004847 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:15:44.004847 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:15:44.006233 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:15:44.006233 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 03:15:44.006233 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 03:15:44.006233 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume acc77ace-8d37-4857-8e81-f7950fb7fa51 is already attached to instances: 4fc83673-1557-4eb9-b80b-825364198d8a Oct 17 03:15:44.006233 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Oct 17 03:15:44.006233 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-f7150310-5c43-41f9-be7c-92d2d1ae5b82 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Returning 400 to user: Invalid volume: volume acc77ace-8d37-4857-8e81-f7950fb7fa51 is already attached to instances: 4fc83673-1557-4eb9-b80b-825364198d8a {{(pid=118886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 03:15:44.006233 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-f7150310-5c43-41f9-be7c-92d2d1ae5b82 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] 10.222.0.27 "POST /compute/v2.1/servers/d834c830-cb7f-43ce-ac79-2bf168e8f664/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.098495 Oct 17 03:15:44.006233 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 297/560] 10.222.0.27 () {60 vars in 1323 bytes} [Mon Oct 17 03:15:43 2022] POST /compute/v2.1/servers/d834c830-cb7f-43ce-ac79-2bf168e8f664/os-volume_attachments => generated 174 bytes in 100 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 03:15:44.012110 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-8c18c2c4-cb17-448e-8334-14f269d101eb tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:15:44.012628 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-8c18c2c4-cb17-448e-8334-14f269d101eb tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] [instance: d834c830-cb7f-43ce-ac79-2bf168e8f664] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:15:44.018399 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-8c18c2c4-cb17-448e-8334-14f269d101eb tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:15:44.018890 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-8c18c2c4-cb17-448e-8334-14f269d101eb tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:15:44.019335 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-8c18c2c4-cb17-448e-8334-14f269d101eb tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:15:44.020014 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-8c18c2c4-cb17-448e-8334-14f269d101eb tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:15:44.020462 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-8c18c2c4-cb17-448e-8334-14f269d101eb tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:15:44.020881 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-8c18c2c4-cb17-448e-8334-14f269d101eb tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:15:44.045445 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-8c18c2c4-cb17-448e-8334-14f269d101eb tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] [instance: d834c830-cb7f-43ce-ac79-2bf168e8f664] Going to try to terminate instance {{(pid=118887) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 03:15:44.048140 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG dbcounter [-] [118887] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=118887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:15:44.119817 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-8c18c2c4-cb17-448e-8334-14f269d101eb tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] 10.222.0.27 "DELETE /compute/v2.1/servers/d834c830-cb7f-43ce-ac79-2bf168e8f664" status: 204 len: 0 microversion: 2.1 time: 0.111871 Oct 17 03:15:44.120335 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 264/561] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 03:15:44 2022] DELETE /compute/v2.1/servers/d834c830-cb7f-43ce-ac79-2bf168e8f664 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 03:15:44.129001 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-242bc611-137a-468b-8331-60c23cab5e97 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:15:44.129602 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-242bc611-137a-468b-8331-60c23cab5e97 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] [instance: d834c830-cb7f-43ce-ac79-2bf168e8f664] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:15:44.137947 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-242bc611-137a-468b-8331-60c23cab5e97 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:15:44.138426 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-242bc611-137a-468b-8331-60c23cab5e97 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:15:44.138857 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-242bc611-137a-468b-8331-60c23cab5e97 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:15:44.139595 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-242bc611-137a-468b-8331-60c23cab5e97 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:15:44.140045 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-242bc611-137a-468b-8331-60c23cab5e97 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:15:44.140464 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-242bc611-137a-468b-8331-60c23cab5e97 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:15:44.270306 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-242bc611-137a-468b-8331-60c23cab5e97 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c786544e8fb4e8e8c3a4990a0f36725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618cf0b3507845909bb27c13460d1d6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:15:44.278389 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-242bc611-137a-468b-8331-60c23cab5e97 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] 10.222.0.27 "GET /compute/v2.1/servers/d834c830-cb7f-43ce-ac79-2bf168e8f664" status: 200 len: 1683 microversion: 2.1 time: 0.153704 Oct 17 03:15:44.278967 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 298/562] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:15:44 2022] GET /compute/v2.1/servers/d834c830-cb7f-43ce-ac79-2bf168e8f664 => generated 1683 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:15:44.295317 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-6c366c63-8876-4b4f-9063-9bc56135b0d1 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:15:44.296120 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-6c366c63-8876-4b4f-9063-9bc56135b0d1 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] [instance: 7b220b35-d9ac-48e4-b898-3d4f6c7be835] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:15:44.301971 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-6c366c63-8876-4b4f-9063-9bc56135b0d1 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:15:44.302450 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-6c366c63-8876-4b4f-9063-9bc56135b0d1 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:15:44.302901 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-6c366c63-8876-4b4f-9063-9bc56135b0d1 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:15:44.303589 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-6c366c63-8876-4b4f-9063-9bc56135b0d1 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:15:44.304038 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-6c366c63-8876-4b4f-9063-9bc56135b0d1 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:15:44.304491 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-6c366c63-8876-4b4f-9063-9bc56135b0d1 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:15:44.433098 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-6c366c63-8876-4b4f-9063-9bc56135b0d1 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce25db99a7b14d0bbaca41fff80e3da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5bad80dc0d74119b2a9cd5c1935e8d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:15:44.440779 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-6c366c63-8876-4b4f-9063-9bc56135b0d1 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] 10.222.0.27 "GET /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835" status: 200 len: 1665 microversion: 2.1 time: 0.149740 Oct 17 03:15:44.441343 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 265/563] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:15:44 2022] GET /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835 => generated 1665 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:15:45.303053 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-1d23aa70-5c8d-4203-af90-1461e6601701 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:15:45.303706 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-1d23aa70-5c8d-4203-af90-1461e6601701 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] [instance: d834c830-cb7f-43ce-ac79-2bf168e8f664] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:15:45.310712 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-1d23aa70-5c8d-4203-af90-1461e6601701 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:15:45.311248 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-1d23aa70-5c8d-4203-af90-1461e6601701 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:15:45.311702 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-1d23aa70-5c8d-4203-af90-1461e6601701 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:15:45.312387 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-1d23aa70-5c8d-4203-af90-1461e6601701 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:15:45.312839 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-1d23aa70-5c8d-4203-af90-1461e6601701 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:15:45.313267 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-1d23aa70-5c8d-4203-af90-1461e6601701 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:15:45.439823 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-1d23aa70-5c8d-4203-af90-1461e6601701 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c786544e8fb4e8e8c3a4990a0f36725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618cf0b3507845909bb27c13460d1d6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:15:45.448125 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-1d23aa70-5c8d-4203-af90-1461e6601701 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] 10.222.0.27 "GET /compute/v2.1/servers/d834c830-cb7f-43ce-ac79-2bf168e8f664" status: 200 len: 1683 microversion: 2.1 time: 0.149168 Oct 17 03:15:45.448691 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 299/564] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:15:45 2022] GET /compute/v2.1/servers/d834c830-cb7f-43ce-ac79-2bf168e8f664 => generated 1683 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:15:45.465493 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-36ed00a7-c330-440a-af5c-4c1a2a0db9c6 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:15:45.466105 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-36ed00a7-c330-440a-af5c-4c1a2a0db9c6 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] [instance: 7b220b35-d9ac-48e4-b898-3d4f6c7be835] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:15:45.472581 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-36ed00a7-c330-440a-af5c-4c1a2a0db9c6 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:15:45.473003 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-36ed00a7-c330-440a-af5c-4c1a2a0db9c6 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:15:45.473436 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-36ed00a7-c330-440a-af5c-4c1a2a0db9c6 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:15:45.474122 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-36ed00a7-c330-440a-af5c-4c1a2a0db9c6 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:15:45.474575 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-36ed00a7-c330-440a-af5c-4c1a2a0db9c6 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:15:45.475058 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-36ed00a7-c330-440a-af5c-4c1a2a0db9c6 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:15:45.603855 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-36ed00a7-c330-440a-af5c-4c1a2a0db9c6 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce25db99a7b14d0bbaca41fff80e3da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5bad80dc0d74119b2a9cd5c1935e8d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:15:45.611600 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-36ed00a7-c330-440a-af5c-4c1a2a0db9c6 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] 10.222.0.27 "GET /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835" status: 200 len: 1665 microversion: 2.1 time: 0.150762 Oct 17 03:15:45.612158 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 266/565] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:15:45 2022] GET /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835 => generated 1665 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:15:46.471983 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-7a4a9fb9-e641-467d-8bde-67010468cf38 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:15:46.472596 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-7a4a9fb9-e641-467d-8bde-67010468cf38 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] [instance: d834c830-cb7f-43ce-ac79-2bf168e8f664] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:15:46.479493 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-7a4a9fb9-e641-467d-8bde-67010468cf38 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:15:46.479978 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-7a4a9fb9-e641-467d-8bde-67010468cf38 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:15:46.480412 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-7a4a9fb9-e641-467d-8bde-67010468cf38 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:15:46.481114 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-7a4a9fb9-e641-467d-8bde-67010468cf38 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:15:46.481568 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-7a4a9fb9-e641-467d-8bde-67010468cf38 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:15:46.481996 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-7a4a9fb9-e641-467d-8bde-67010468cf38 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:15:46.614362 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-7a4a9fb9-e641-467d-8bde-67010468cf38 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c786544e8fb4e8e8c3a4990a0f36725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618cf0b3507845909bb27c13460d1d6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:15:46.622807 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-7a4a9fb9-e641-467d-8bde-67010468cf38 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] 10.222.0.27 "GET /compute/v2.1/servers/d834c830-cb7f-43ce-ac79-2bf168e8f664" status: 200 len: 1683 microversion: 2.1 time: 0.154667 Oct 17 03:15:46.623482 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 300/566] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:15:46 2022] GET /compute/v2.1/servers/d834c830-cb7f-43ce-ac79-2bf168e8f664 => generated 1683 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:15:46.637574 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-f0731776-6d40-4c4c-90ab-6ad97a4c608c tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:15:46.638790 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-f0731776-6d40-4c4c-90ab-6ad97a4c608c tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] [instance: 7b220b35-d9ac-48e4-b898-3d4f6c7be835] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:15:46.652712 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-f0731776-6d40-4c4c-90ab-6ad97a4c608c tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:15:46.653495 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-f0731776-6d40-4c4c-90ab-6ad97a4c608c tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:15:46.653958 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-f0731776-6d40-4c4c-90ab-6ad97a4c608c tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:15:46.654701 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-f0731776-6d40-4c4c-90ab-6ad97a4c608c tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:15:46.655220 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-f0731776-6d40-4c4c-90ab-6ad97a4c608c tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:15:46.655653 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-f0731776-6d40-4c4c-90ab-6ad97a4c608c tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:15:46.937997 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-f0731776-6d40-4c4c-90ab-6ad97a4c608c tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce25db99a7b14d0bbaca41fff80e3da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5bad80dc0d74119b2a9cd5c1935e8d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:15:46.945619 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-f0731776-6d40-4c4c-90ab-6ad97a4c608c tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] 10.222.0.27 "GET /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835" status: 200 len: 1665 microversion: 2.1 time: 0.314453 Oct 17 03:15:46.946189 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 267/567] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:15:46 2022] GET /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835 => generated 1665 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:15:47.414229 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [req-92c385ab-dc06-4df6-bd51-48b667829a7b req-958bb908-1ad1-48b8-b1ee-ecbcaea9f485 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d834c830-cb7f-43ce-ac79-2bf168e8f664", "name": "network-vif-deleted", "tag": "7589b628-e985-4bc3-a2e0-858b8f897a49"}]} {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:15:47.424511 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [req-92c385ab-dc06-4df6-bd51-48b667829a7b req-958bb908-1ad1-48b8-b1ee-ecbcaea9f485 service nova] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:15:47.425260 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [req-92c385ab-dc06-4df6-bd51-48b667829a7b req-958bb908-1ad1-48b8-b1ee-ecbcaea9f485 service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:15:47.425858 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [req-92c385ab-dc06-4df6-bd51-48b667829a7b req-958bb908-1ad1-48b8-b1ee-ecbcaea9f485 service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:15:47.438518 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.compute.server_external_events [req-92c385ab-dc06-4df6-bd51-48b667829a7b req-958bb908-1ad1-48b8-b1ee-ecbcaea9f485 service nova] Creating event network-vif-deleted:7589b628-e985-4bc3-a2e0-858b8f897a49 for instance d834c830-cb7f-43ce-ac79-2bf168e8f664 on hv-cinder-84697 Oct 17 03:15:47.445317 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [req-92c385ab-dc06-4df6-bd51-48b667829a7b req-958bb908-1ad1-48b8-b1ee-ecbcaea9f485 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034465 Oct 17 03:15:47.446321 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 301/568] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 03:15:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:15:47.646648 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-682827cc-9ddf-4ca1-acf7-b91108c889fe tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:15:47.647865 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-682827cc-9ddf-4ca1-acf7-b91108c889fe tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] [instance: d834c830-cb7f-43ce-ac79-2bf168e8f664] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:15:47.663795 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-682827cc-9ddf-4ca1-acf7-b91108c889fe tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:15:47.664275 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-682827cc-9ddf-4ca1-acf7-b91108c889fe tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:15:47.664696 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-682827cc-9ddf-4ca1-acf7-b91108c889fe tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:15:47.665421 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-682827cc-9ddf-4ca1-acf7-b91108c889fe tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:15:47.665863 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-682827cc-9ddf-4ca1-acf7-b91108c889fe tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:15:47.666277 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-682827cc-9ddf-4ca1-acf7-b91108c889fe tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:15:47.764921 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-682827cc-9ddf-4ca1-acf7-b91108c889fe tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c786544e8fb4e8e8c3a4990a0f36725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618cf0b3507845909bb27c13460d1d6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:15:47.776769 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-682827cc-9ddf-4ca1-acf7-b91108c889fe tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] 10.222.0.27 "GET /compute/v2.1/servers/d834c830-cb7f-43ce-ac79-2bf168e8f664" status: 200 len: 1327 microversion: 2.1 time: 0.133907 Oct 17 03:15:47.777545 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 268/569] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:15:47 2022] GET /compute/v2.1/servers/d834c830-cb7f-43ce-ac79-2bf168e8f664 => generated 1327 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:15:47.971662 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-d0e08a23-e215-495c-8fbf-09f03703c7c4 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:15:47.972509 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-d0e08a23-e215-495c-8fbf-09f03703c7c4 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] [instance: 7b220b35-d9ac-48e4-b898-3d4f6c7be835] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:15:47.982059 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-d0e08a23-e215-495c-8fbf-09f03703c7c4 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:15:47.982611 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-d0e08a23-e215-495c-8fbf-09f03703c7c4 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:15:47.983462 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-d0e08a23-e215-495c-8fbf-09f03703c7c4 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:15:47.984928 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-d0e08a23-e215-495c-8fbf-09f03703c7c4 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:15:47.985589 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-d0e08a23-e215-495c-8fbf-09f03703c7c4 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:15:47.986202 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-d0e08a23-e215-495c-8fbf-09f03703c7c4 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:15:48.132143 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-d0e08a23-e215-495c-8fbf-09f03703c7c4 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce25db99a7b14d0bbaca41fff80e3da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5bad80dc0d74119b2a9cd5c1935e8d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:15:48.140617 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-d0e08a23-e215-495c-8fbf-09f03703c7c4 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] 10.222.0.27 "GET /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835" status: 200 len: 1669 microversion: 2.1 time: 0.173660 Oct 17 03:15:48.141175 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 302/570] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:15:47 2022] GET /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835 => generated 1669 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:15:48.801360 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-9ef8d8cd-bdca-4d2b-b56a-bc170a8aa057 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:15:48.801973 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-9ef8d8cd-bdca-4d2b-b56a-bc170a8aa057 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] [instance: d834c830-cb7f-43ce-ac79-2bf168e8f664] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:15:48.808745 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-9ef8d8cd-bdca-4d2b-b56a-bc170a8aa057 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:15:48.809232 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-9ef8d8cd-bdca-4d2b-b56a-bc170a8aa057 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:15:48.809716 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-9ef8d8cd-bdca-4d2b-b56a-bc170a8aa057 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:15:48.810416 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-9ef8d8cd-bdca-4d2b-b56a-bc170a8aa057 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:15:48.810888 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-9ef8d8cd-bdca-4d2b-b56a-bc170a8aa057 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:15:48.811317 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-9ef8d8cd-bdca-4d2b-b56a-bc170a8aa057 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:15:48.826610 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.wsgi [None req-9ef8d8cd-bdca-4d2b-b56a-bc170a8aa057 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] HTTP exception thrown: Instance d834c830-cb7f-43ce-ac79-2bf168e8f664 could not be found. Oct 17 03:15:48.828489 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-9ef8d8cd-bdca-4d2b-b56a-bc170a8aa057 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Request method failure captured: Oct 17 03:15:48.828489 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: request: GET /compute/v2.1/servers/d834c830-cb7f-43ce-ac79-2bf168e8f664 HTTP/1.1 Oct 17 03:15:48.828489 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Accept: application/json Oct 17 03:15:48.828489 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Accept-Encoding: identity Oct 17 03:15:48.828489 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Connection: close Oct 17 03:15:48.828489 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Content-Length: 0 Oct 17 03:15:48.828489 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Content-Type: application/json Oct 17 03:15:48.828489 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Host: 10.222.0.27 Oct 17 03:15:48.828489 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Openstack-System-Scope: None Oct 17 03:15:48.828489 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: User-Agent: python-urllib3/1.26.12 Oct 17 03:15:48.828489 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Auth-Token: gAAAAABjTMf-SpDw6REUqxlSOIvhtlgFxCyi7gugHXw9249WtXgpgYG8a0yyM9JbvLErgztKU1aaT378mlFtg9Uhrjdru2uD9-W4FJ-CkFLSVPWuyDvIf6q3m3rDvz5qZHkGg2K6V9p96rkOt2BGqAhrNrGmStKoZpndwIVbln6Rg2eRSFSEBDA Oct 17 03:15:48.828489 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Domain-Id: None Oct 17 03:15:48.828489 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Domain-Name: None Oct 17 03:15:48.828489 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Identity-Status: Confirmed Oct 17 03:15:48.828489 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Is-Admin-Project: True Oct 17 03:15:48.828489 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Project-Domain-Id: default Oct 17 03:15:48.828489 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Project-Domain-Name: Default Oct 17 03:15:48.828489 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Project-Id: 618cf0b3507845909bb27c13460d1d6c Oct 17 03:15:48.828489 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Project-Name: tempest-AttachVolumeNegativeTest-816799241 Oct 17 03:15:48.828489 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Role: member,reader Oct 17 03:15:48.828489 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Roles: member,reader Oct 17 03:15:48.830120 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/618cf0b3507845909bb27c13460d1d6c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/618cf0b3507845909bb27c13460d1d6c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/618cf0b3507845909bb27c13460d1d6c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_618cf0b3507845909bb27c13460d1d6c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 17 03:15:48.830120 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Tenant: tempest-AttachVolumeNegativeTest-816799241 Oct 17 03:15:48.830120 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Tenant-Id: 618cf0b3507845909bb27c13460d1d6c Oct 17 03:15:48.830120 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-816799241 Oct 17 03:15:48.830120 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-User: tempest-AttachVolumeNegativeTest-816799241-project Oct 17 03:15:48.830120 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-User-Domain-Id: default Oct 17 03:15:48.830120 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-User-Domain-Name: Default Oct 17 03:15:48.830120 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-User-Id: 1c786544e8fb4e8e8c3a4990a0f36725 Oct 17 03:15:48.830120 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-User-Name: tempest-AttachVolumeNegativeTest-816799241-project Oct 17 03:15:48.830120 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: method: > Oct 17 03:15:48.830120 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: exception: Instance d834c830-cb7f-43ce-ac79-2bf168e8f664 could not be found. Oct 17 03:15:48.830120 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: action_args: {'id': 'd834c830-cb7f-43ce-ac79-2bf168e8f664'} Oct 17 03:15:48.831415 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 03:15:48.831415 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:15:48.831415 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 03:15:48.831415 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 03:15:48.831415 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 03:15:48.831415 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 03:15:48.831415 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 03:15:48.831415 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 03:15:48.831415 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 03:15:48.831415 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 03:15:48.831415 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d834c830-cb7f-43ce-ac79-2bf168e8f664 could not be found. Oct 17 03:15:48.831415 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Oct 17 03:15:48.831415 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:15:48.831415 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Oct 17 03:15:48.831415 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:15:48.831415 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:15:48.831415 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:15:48.831415 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 03:15:48.831415 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 03:15:48.831415 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 03:15:48.832809 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 03:15:48.832809 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 03:15:48.832809 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 03:15:48.832809 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 03:15:48.832809 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 03:15:48.832809 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 03:15:48.832809 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 03:15:48.832809 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d834c830-cb7f-43ce-ac79-2bf168e8f664 could not be found. Oct 17 03:15:48.832809 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Oct 17 03:15:48.832809 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:15:48.832809 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Oct 17 03:15:48.832809 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:15:48.832809 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:15:48.832809 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:15:48.832809 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 03:15:48.832809 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 03:15:48.832809 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d834c830-cb7f-43ce-ac79-2bf168e8f664 could not be found. Oct 17 03:15:48.832809 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Oct 17 03:15:48.834300 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-9ef8d8cd-bdca-4d2b-b56a-bc170a8aa057 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Returning 404 to user: Instance d834c830-cb7f-43ce-ac79-2bf168e8f664 could not be found. {{(pid=118887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 03:15:48.834300 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-9ef8d8cd-bdca-4d2b-b56a-bc170a8aa057 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] 10.222.0.27 "GET /compute/v2.1/servers/d834c830-cb7f-43ce-ac79-2bf168e8f664" status: 404 len: 111 microversion: 2.1 time: 0.032545 Oct 17 03:15:48.834300 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 269/571] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:15:48 2022] GET /compute/v2.1/servers/d834c830-cb7f-43ce-ac79-2bf168e8f664 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 03:15:48.839403 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-6e6b807b-5fcd-407d-b539-3522a26a9216 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Calling method '.version_select at 0x7fc7017264c0>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:15:48.860450 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-6e6b807b-5fcd-407d-b539-3522a26a9216 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2077377061" status: 202 len: 0 microversion: 2.1 time: 0.025403 Oct 17 03:15:48.861261 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 303/572] 10.222.0.27 () {58 vars in 1221 bytes} [Mon Oct 17 03:15:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2077377061 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 03:15:49.603347 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-a483548b-9718-4dfe-a149-4882d6a5f6f2 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:15:49.603920 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-a483548b-9718-4dfe-a149-4882d6a5f6f2 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] [instance: 4fc83673-1557-4eb9-b80b-825364198d8a] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:15:49.609924 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-a483548b-9718-4dfe-a149-4882d6a5f6f2 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:15:49.610489 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-a483548b-9718-4dfe-a149-4882d6a5f6f2 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:15:49.611034 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-a483548b-9718-4dfe-a149-4882d6a5f6f2 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:15:49.611785 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-a483548b-9718-4dfe-a149-4882d6a5f6f2 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:15:49.612307 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-a483548b-9718-4dfe-a149-4882d6a5f6f2 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:15:49.612794 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-a483548b-9718-4dfe-a149-4882d6a5f6f2 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:15:49.699530 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.objects.instance [None req-a483548b-9718-4dfe-a149-4882d6a5f6f2 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lazy-loading 'services' on Instance uuid 4fc83673-1557-4eb9-b80b-825364198d8a {{(pid=118887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 03:15:49.772933 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-a483548b-9718-4dfe-a149-4882d6a5f6f2 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] 10.222.0.27 "DELETE /compute/v2.1/servers/4fc83673-1557-4eb9-b80b-825364198d8a/os-volume_attachments/acc77ace-8d37-4857-8e81-f7950fb7fa51" status: 202 len: 0 microversion: 2.1 time: 0.174065 Oct 17 03:15:49.773526 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 270/573] 10.222.0.27 () {58 vars in 1416 bytes} [Mon Oct 17 03:15:49 2022] DELETE /compute/v2.1/servers/4fc83673-1557-4eb9-b80b-825364198d8a/os-volume_attachments/acc77ace-8d37-4857-8e81-f7950fb7fa51 => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 03:15:49.783206 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-8130cbbf-f629-49f8-9ff9-fa61a9b6c7c9 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:15:49.785438 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-8130cbbf-f629-49f8-9ff9-fa61a9b6c7c9 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] [instance: 4fc83673-1557-4eb9-b80b-825364198d8a] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:15:49.795121 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-8130cbbf-f629-49f8-9ff9-fa61a9b6c7c9 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:15:49.795653 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-8130cbbf-f629-49f8-9ff9-fa61a9b6c7c9 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:15:49.796110 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-8130cbbf-f629-49f8-9ff9-fa61a9b6c7c9 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:15:49.796874 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-8130cbbf-f629-49f8-9ff9-fa61a9b6c7c9 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:15:49.797408 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-8130cbbf-f629-49f8-9ff9-fa61a9b6c7c9 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:15:49.797893 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-8130cbbf-f629-49f8-9ff9-fa61a9b6c7c9 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:15:49.827351 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-8130cbbf-f629-49f8-9ff9-fa61a9b6c7c9 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] 10.222.0.27 "GET /compute/v2.1/servers/4fc83673-1557-4eb9-b80b-825364198d8a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048662 Oct 17 03:15:49.827906 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 304/574] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 17 03:15:49 2022] GET /compute/v2.1/servers/4fc83673-1557-4eb9-b80b-825364198d8a/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:15:50.841652 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-71070ab3-7302-4370-bf70-8286864cf863 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:15:50.844436 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-71070ab3-7302-4370-bf70-8286864cf863 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] [instance: 4fc83673-1557-4eb9-b80b-825364198d8a] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:15:50.850772 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-71070ab3-7302-4370-bf70-8286864cf863 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:15:50.851293 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-71070ab3-7302-4370-bf70-8286864cf863 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:15:50.851731 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-71070ab3-7302-4370-bf70-8286864cf863 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:15:50.853078 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-71070ab3-7302-4370-bf70-8286864cf863 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:15:50.853528 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-71070ab3-7302-4370-bf70-8286864cf863 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:15:50.854077 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-71070ab3-7302-4370-bf70-8286864cf863 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:15:50.885989 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-71070ab3-7302-4370-bf70-8286864cf863 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] 10.222.0.27 "GET /compute/v2.1/servers/4fc83673-1557-4eb9-b80b-825364198d8a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049181 Oct 17 03:15:50.886507 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 271/575] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 17 03:15:50 2022] GET /compute/v2.1/servers/4fc83673-1557-4eb9-b80b-825364198d8a/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 03:15:50.957558 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-e5ff1e3c-0c6c-43e1-adf9-cc0b5a735353 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:15:50.958130 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-e5ff1e3c-0c6c-43e1-adf9-cc0b5a735353 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] [instance: 4fc83673-1557-4eb9-b80b-825364198d8a] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:15:50.965254 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-e5ff1e3c-0c6c-43e1-adf9-cc0b5a735353 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:15:50.965845 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-e5ff1e3c-0c6c-43e1-adf9-cc0b5a735353 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:15:50.966374 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-e5ff1e3c-0c6c-43e1-adf9-cc0b5a735353 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:15:50.967260 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-e5ff1e3c-0c6c-43e1-adf9-cc0b5a735353 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:15:50.967787 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-e5ff1e3c-0c6c-43e1-adf9-cc0b5a735353 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:15:50.968281 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-e5ff1e3c-0c6c-43e1-adf9-cc0b5a735353 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:15:50.997360 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-e5ff1e3c-0c6c-43e1-adf9-cc0b5a735353 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] [instance: 4fc83673-1557-4eb9-b80b-825364198d8a] Going to try to terminate instance {{(pid=118886) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 03:15:51.079645 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-e5ff1e3c-0c6c-43e1-adf9-cc0b5a735353 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] 10.222.0.27 "DELETE /compute/v2.1/servers/4fc83673-1557-4eb9-b80b-825364198d8a" status: 204 len: 0 microversion: 2.1 time: 0.126017 Oct 17 03:15:51.080715 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 305/576] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 03:15:50 2022] DELETE /compute/v2.1/servers/4fc83673-1557-4eb9-b80b-825364198d8a => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 03:15:51.090277 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-23e4b61f-da40-476d-adcf-add0cd889513 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:15:51.090816 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-23e4b61f-da40-476d-adcf-add0cd889513 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] [instance: 4fc83673-1557-4eb9-b80b-825364198d8a] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:15:51.097050 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-23e4b61f-da40-476d-adcf-add0cd889513 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:15:51.097536 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-23e4b61f-da40-476d-adcf-add0cd889513 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:15:51.097972 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-23e4b61f-da40-476d-adcf-add0cd889513 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:15:51.098666 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-23e4b61f-da40-476d-adcf-add0cd889513 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:15:51.099152 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-23e4b61f-da40-476d-adcf-add0cd889513 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:15:51.099572 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-23e4b61f-da40-476d-adcf-add0cd889513 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:15:51.248549 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-23e4b61f-da40-476d-adcf-add0cd889513 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c786544e8fb4e8e8c3a4990a0f36725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618cf0b3507845909bb27c13460d1d6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:15:51.256232 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-23e4b61f-da40-476d-adcf-add0cd889513 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] 10.222.0.27 "GET /compute/v2.1/servers/4fc83673-1557-4eb9-b80b-825364198d8a" status: 200 len: 1682 microversion: 2.1 time: 0.171320 Oct 17 03:15:51.256798 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 272/577] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:15:51 2022] GET /compute/v2.1/servers/4fc83673-1557-4eb9-b80b-825364198d8a => generated 1682 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:15:52.280640 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-cf178a1e-6bb7-44a9-8ec5-f6b61c57848e tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:15:52.281619 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-cf178a1e-6bb7-44a9-8ec5-f6b61c57848e tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] [instance: 4fc83673-1557-4eb9-b80b-825364198d8a] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:15:52.288086 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-cf178a1e-6bb7-44a9-8ec5-f6b61c57848e tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:15:52.288585 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-cf178a1e-6bb7-44a9-8ec5-f6b61c57848e tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:15:52.289005 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-cf178a1e-6bb7-44a9-8ec5-f6b61c57848e tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:15:52.289702 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-cf178a1e-6bb7-44a9-8ec5-f6b61c57848e tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:15:52.290659 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-cf178a1e-6bb7-44a9-8ec5-f6b61c57848e tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:15:52.291256 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-cf178a1e-6bb7-44a9-8ec5-f6b61c57848e tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:15:52.421056 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-cf178a1e-6bb7-44a9-8ec5-f6b61c57848e tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c786544e8fb4e8e8c3a4990a0f36725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618cf0b3507845909bb27c13460d1d6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:15:52.428760 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-cf178a1e-6bb7-44a9-8ec5-f6b61c57848e tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] 10.222.0.27 "GET /compute/v2.1/servers/4fc83673-1557-4eb9-b80b-825364198d8a" status: 200 len: 1682 microversion: 2.1 time: 0.152477 Oct 17 03:15:52.429322 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 306/578] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:15:52 2022] GET /compute/v2.1/servers/4fc83673-1557-4eb9-b80b-825364198d8a => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:15:52.451449 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-2fdb3ee5-0bdb-4f64-890b-029282d5958f tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9d69f510-3752-49d0-ab13-0ab7bff311d8"}} {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:15:52.453793 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-2fdb3ee5-0bdb-4f64-890b-029282d5958f tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: 712578d1-d2fb-4252-adbb-bc87096acc00] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:15:52.460199 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-2fdb3ee5-0bdb-4f64-890b-029282d5958f tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:15:52.460673 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-2fdb3ee5-0bdb-4f64-890b-029282d5958f tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:15:52.461102 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-2fdb3ee5-0bdb-4f64-890b-029282d5958f tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:15:52.461783 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-2fdb3ee5-0bdb-4f64-890b-029282d5958f tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:15:52.462228 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-2fdb3ee5-0bdb-4f64-890b-029282d5958f tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:15:52.462645 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-2fdb3ee5-0bdb-4f64-890b-029282d5958f tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:15:52.729308 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-2fdb3ee5-0bdb-4f64-890b-029282d5958f tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "POST /compute/v2.1/servers/712578d1-d2fb-4252-adbb-bc87096acc00/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.281437 Oct 17 03:15:52.729919 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 273/579] 10.222.0.27 () {60 vars in 1323 bytes} [Mon Oct 17 03:15:52 2022] POST /compute/v2.1/servers/712578d1-d2fb-4252-adbb-bc87096acc00/os-volume_attachments => generated 194 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:15:53.453875 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-121f9b0b-5d8a-49d9-b724-b6ef819b134a tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:15:53.455530 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-121f9b0b-5d8a-49d9-b724-b6ef819b134a tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] [instance: 4fc83673-1557-4eb9-b80b-825364198d8a] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:15:53.463859 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-121f9b0b-5d8a-49d9-b724-b6ef819b134a tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:15:53.464232 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-121f9b0b-5d8a-49d9-b724-b6ef819b134a tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:15:53.464662 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-121f9b0b-5d8a-49d9-b724-b6ef819b134a tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:15:53.465510 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-121f9b0b-5d8a-49d9-b724-b6ef819b134a tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:15:53.466161 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-121f9b0b-5d8a-49d9-b724-b6ef819b134a tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:15:53.466724 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-121f9b0b-5d8a-49d9-b724-b6ef819b134a tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:15:53.545525 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-121f9b0b-5d8a-49d9-b724-b6ef819b134a tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c786544e8fb4e8e8c3a4990a0f36725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618cf0b3507845909bb27c13460d1d6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:15:53.553398 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-121f9b0b-5d8a-49d9-b724-b6ef819b134a tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] 10.222.0.27 "GET /compute/v2.1/servers/4fc83673-1557-4eb9-b80b-825364198d8a" status: 200 len: 1614 microversion: 2.1 time: 0.103762 Oct 17 03:15:53.554020 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 307/580] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:15:53 2022] GET /compute/v2.1/servers/4fc83673-1557-4eb9-b80b-825364198d8a => generated 1614 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:15:53.746485 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [req-bb83d4bd-4862-4a9e-9729-ec6061467ca7 req-46a5a9be-aa66-47a6-9f81-56801aabf701 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fc83673-1557-4eb9-b80b-825364198d8a", "name": "network-vif-deleted", "tag": "4df765f6-05e9-4846-a92d-d12d217252a8"}]} {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:15:53.763397 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [req-bb83d4bd-4862-4a9e-9729-ec6061467ca7 req-46a5a9be-aa66-47a6-9f81-56801aabf701 service nova] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:15:53.763963 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [req-bb83d4bd-4862-4a9e-9729-ec6061467ca7 req-46a5a9be-aa66-47a6-9f81-56801aabf701 service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:15:53.764556 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [req-bb83d4bd-4862-4a9e-9729-ec6061467ca7 req-46a5a9be-aa66-47a6-9f81-56801aabf701 service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:15:53.777242 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.compute.server_external_events [req-bb83d4bd-4862-4a9e-9729-ec6061467ca7 req-46a5a9be-aa66-47a6-9f81-56801aabf701 service nova] Creating event network-vif-deleted:4df765f6-05e9-4846-a92d-d12d217252a8 for instance 4fc83673-1557-4eb9-b80b-825364198d8a on hv-cinder-84697 Oct 17 03:15:53.782450 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [req-bb83d4bd-4862-4a9e-9729-ec6061467ca7 req-46a5a9be-aa66-47a6-9f81-56801aabf701 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041606 Oct 17 03:15:53.784586 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 274/581] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 03:15:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:15:54.577735 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-4c3b5bc7-234e-4790-9f1e-77cc0e9bd1db tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:15:54.578497 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-4c3b5bc7-234e-4790-9f1e-77cc0e9bd1db tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] [instance: 4fc83673-1557-4eb9-b80b-825364198d8a] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:15:54.581104 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG dbcounter [-] [118886] Writing DB stats nova_api:SELECT=57,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=118886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:15:54.586670 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-4c3b5bc7-234e-4790-9f1e-77cc0e9bd1db tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:15:54.587681 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-4c3b5bc7-234e-4790-9f1e-77cc0e9bd1db tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:15:54.588113 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-4c3b5bc7-234e-4790-9f1e-77cc0e9bd1db tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:15:54.588838 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-4c3b5bc7-234e-4790-9f1e-77cc0e9bd1db tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:15:54.589288 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-4c3b5bc7-234e-4790-9f1e-77cc0e9bd1db tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:15:54.589712 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-4c3b5bc7-234e-4790-9f1e-77cc0e9bd1db tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:15:54.612718 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.wsgi [None req-4c3b5bc7-234e-4790-9f1e-77cc0e9bd1db tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] HTTP exception thrown: Instance 4fc83673-1557-4eb9-b80b-825364198d8a could not be found. Oct 17 03:15:54.614366 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-4c3b5bc7-234e-4790-9f1e-77cc0e9bd1db tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Request method failure captured: Oct 17 03:15:54.614366 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: request: GET /compute/v2.1/servers/4fc83673-1557-4eb9-b80b-825364198d8a HTTP/1.1 Oct 17 03:15:54.614366 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Accept: application/json Oct 17 03:15:54.614366 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Accept-Encoding: identity Oct 17 03:15:54.614366 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Connection: close Oct 17 03:15:54.614366 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Content-Length: 0 Oct 17 03:15:54.614366 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Content-Type: application/json Oct 17 03:15:54.614366 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Host: 10.222.0.27 Oct 17 03:15:54.614366 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Openstack-System-Scope: None Oct 17 03:15:54.614366 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: User-Agent: python-urllib3/1.26.12 Oct 17 03:15:54.614366 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Auth-Token: gAAAAABjTMf-SpDw6REUqxlSOIvhtlgFxCyi7gugHXw9249WtXgpgYG8a0yyM9JbvLErgztKU1aaT378mlFtg9Uhrjdru2uD9-W4FJ-CkFLSVPWuyDvIf6q3m3rDvz5qZHkGg2K6V9p96rkOt2BGqAhrNrGmStKoZpndwIVbln6Rg2eRSFSEBDA Oct 17 03:15:54.614366 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Domain-Id: None Oct 17 03:15:54.614366 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Domain-Name: None Oct 17 03:15:54.614366 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Identity-Status: Confirmed Oct 17 03:15:54.614366 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Is-Admin-Project: True Oct 17 03:15:54.614366 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Project-Domain-Id: default Oct 17 03:15:54.614366 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Project-Domain-Name: Default Oct 17 03:15:54.614366 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Project-Id: 618cf0b3507845909bb27c13460d1d6c Oct 17 03:15:54.614366 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Project-Name: tempest-AttachVolumeNegativeTest-816799241 Oct 17 03:15:54.614366 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Role: member,reader Oct 17 03:15:54.614366 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Roles: member,reader Oct 17 03:15:54.615759 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/618cf0b3507845909bb27c13460d1d6c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/618cf0b3507845909bb27c13460d1d6c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/618cf0b3507845909bb27c13460d1d6c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_618cf0b3507845909bb27c13460d1d6c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 17 03:15:54.615759 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Tenant: tempest-AttachVolumeNegativeTest-816799241 Oct 17 03:15:54.615759 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Tenant-Id: 618cf0b3507845909bb27c13460d1d6c Oct 17 03:15:54.615759 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-816799241 Oct 17 03:15:54.615759 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-User: tempest-AttachVolumeNegativeTest-816799241-project Oct 17 03:15:54.615759 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-User-Domain-Id: default Oct 17 03:15:54.615759 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-User-Domain-Name: Default Oct 17 03:15:54.615759 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-User-Id: 1c786544e8fb4e8e8c3a4990a0f36725 Oct 17 03:15:54.615759 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-User-Name: tempest-AttachVolumeNegativeTest-816799241-project Oct 17 03:15:54.615759 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: method: > Oct 17 03:15:54.615759 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: exception: Instance 4fc83673-1557-4eb9-b80b-825364198d8a could not be found. Oct 17 03:15:54.615759 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: action_args: {'id': '4fc83673-1557-4eb9-b80b-825364198d8a'} Oct 17 03:15:54.616555 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 03:15:54.616555 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:15:54.616555 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 03:15:54.616555 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 03:15:54.616555 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 03:15:54.616555 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 03:15:54.616555 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 03:15:54.616555 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 03:15:54.616555 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 03:15:54.616555 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 03:15:54.616555 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4fc83673-1557-4eb9-b80b-825364198d8a could not be found. Oct 17 03:15:54.616555 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Oct 17 03:15:54.616555 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:15:54.616555 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Oct 17 03:15:54.616555 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:15:54.616555 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:15:54.616555 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:15:54.616555 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 03:15:54.616555 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 03:15:54.616555 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 03:15:54.617882 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 03:15:54.617882 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 03:15:54.617882 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 03:15:54.617882 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 03:15:54.617882 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 03:15:54.617882 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 03:15:54.617882 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 03:15:54.617882 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4fc83673-1557-4eb9-b80b-825364198d8a could not be found. Oct 17 03:15:54.617882 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Oct 17 03:15:54.617882 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:15:54.617882 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Oct 17 03:15:54.617882 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:15:54.617882 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:15:54.617882 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:15:54.617882 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 03:15:54.617882 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 03:15:54.617882 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4fc83673-1557-4eb9-b80b-825364198d8a could not be found. Oct 17 03:15:54.617882 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Oct 17 03:15:54.619108 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-4c3b5bc7-234e-4790-9f1e-77cc0e9bd1db tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Returning 404 to user: Instance 4fc83673-1557-4eb9-b80b-825364198d8a could not be found. {{(pid=118886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 03:15:54.619108 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-4c3b5bc7-234e-4790-9f1e-77cc0e9bd1db tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] 10.222.0.27 "GET /compute/v2.1/servers/4fc83673-1557-4eb9-b80b-825364198d8a" status: 404 len: 111 microversion: 2.1 time: 0.041952 Oct 17 03:15:54.619108 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 308/582] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:15:54 2022] GET /compute/v2.1/servers/4fc83673-1557-4eb9-b80b-825364198d8a => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 03:15:54.625472 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-090c360c-bd4c-41ec-a0aa-36028599f950 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Calling method '.version_select at 0x7fc701820160>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:15:54.648695 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-090c360c-bd4c-41ec-a0aa-36028599f950 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1429465092" status: 202 len: 0 microversion: 2.1 time: 0.027248 Oct 17 03:15:54.649919 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 275/583] 10.222.0.27 () {58 vars in 1221 bytes} [Mon Oct 17 03:15:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1429465092 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 03:15:55.272994 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-b4b86c2a-fb91-4bb6-b9a5-2ee2e64c3147 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Action: 'create', calling method: .version_select at 0x7fc7017ea8b0>, body: {"keypair": {"name": "tempest-keypair-795925854", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOtu99PRjHIZxI2IkHicCz5eKtWrDqOC/lY3oS5eluLF8dypVeEk0pJwO0rWE4V7edo/XAxxLJ0IrX7jISBYpJAnVizJBp64H2O461Yy/AooCIexmOQ8oPmEUC9LJPnJ4Q=="}} {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:15:55.289500 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.quota [None req-b4b86c2a-fb91-4bb6-b9a5-2ee2e64c3147 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Getting quotas for project 618cf0b3507845909bb27c13460d1d6c. Resources: {'key_pairs'} {{(pid=118886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 03:15:55.294067 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.quota [None req-b4b86c2a-fb91-4bb6-b9a5-2ee2e64c3147 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Getting quotas for user 1c786544e8fb4e8e8c3a4990a0f36725 and project 618cf0b3507845909bb27c13460d1d6c. Resources: {'key_pairs'} {{(pid=118886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 03:15:55.316682 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-b4b86c2a-fb91-4bb6-b9a5-2ee2e64c3147 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.047591 Oct 17 03:15:55.317281 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 309/584] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 17 03:15:55 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:15:56.554421 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-4e9f10a8-7f03-4453-8318-dff9c72c1f0b tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-416870920", "imageRef": "e6d41914-f1bc-4b72-9113-1a69b3d0d83b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5bef7eaf-4926-430d-bb2f-ad10a16554bf"}], "security_groups": [{"name": "tempest-securitygroup--25809290"}], "key_name": "tempest-keypair-795925854", "user_data": "}} {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:15:56.564508 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG dbcounter [-] [118887] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=118887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:15:56.667432 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.network.neutron [None req-4e9f10a8-7f03-4453-8318-dff9c72c1f0b tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] validate_networks() for [('5bef7eaf-4926-430d-bb2f-ad10a16554bf', None, None, None, None, None)] {{(pid=118887) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 03:15:57.026037 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.virt.hardware [None req-4e9f10a8-7f03-4453-8318-dff9c72c1f0b tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Flavor limits 0:0:0 {{(pid=118887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 03:15:57.026461 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.virt.hardware [None req-4e9f10a8-7f03-4453-8318-dff9c72c1f0b tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Image limits 0:0:0 {{(pid=118887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 03:15:57.026966 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.virt.hardware [None req-4e9f10a8-7f03-4453-8318-dff9c72c1f0b tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Flavor pref 0:0:0 {{(pid=118887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 03:15:57.027403 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.virt.hardware [None req-4e9f10a8-7f03-4453-8318-dff9c72c1f0b tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Image pref 0:0:0 {{(pid=118887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 03:15:57.027871 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.virt.hardware [None req-4e9f10a8-7f03-4453-8318-dff9c72c1f0b tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 03:15:57.036993 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-4e9f10a8-7f03-4453-8318-dff9c72c1f0b tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:15:57.037695 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-4e9f10a8-7f03-4453-8318-dff9c72c1f0b tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:15:57.038129 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-4e9f10a8-7f03-4453-8318-dff9c72c1f0b tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:15:57.038851 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-4e9f10a8-7f03-4453-8318-dff9c72c1f0b tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:15:57.039410 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-4e9f10a8-7f03-4453-8318-dff9c72c1f0b tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:15:57.039728 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-4e9f10a8-7f03-4453-8318-dff9c72c1f0b tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:15:57.057158 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.quota [None req-4e9f10a8-7f03-4453-8318-dff9c72c1f0b tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Getting quotas for project 618cf0b3507845909bb27c13460d1d6c. Resources: {'instances', 'cores', 'ram'} {{(pid=118887) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 03:15:57.061267 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.quota [None req-4e9f10a8-7f03-4453-8318-dff9c72c1f0b tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Getting quotas for user 1c786544e8fb4e8e8c3a4990a0f36725 and project 618cf0b3507845909bb27c13460d1d6c. Resources: {'instances', 'cores', 'ram'} {{(pid=118887) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 03:15:57.073251 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-4e9f10a8-7f03-4453-8318-dff9c72c1f0b tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Going to run 1 instances... {{(pid=118887) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 03:15:57.075644 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-4e9f10a8-7f03-4453-8318-dff9c72c1f0b tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] [instance: d521fa69-4f04-4d79-8a81-22b2e4bafbae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e6d41914-f1bc-4b72-9113-1a69b3d0d83b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118887) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 03:15:57.121054 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-4e9f10a8-7f03-4453-8318-dff9c72c1f0b tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.571408 Oct 17 03:15:57.121617 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 276/585] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 03:15:56 2022] POST /compute/v2.1/servers => generated 400 bytes in 573 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 03:15:57.132807 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-19a6e303-4d46-460d-a79d-1c280b9ce012 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:15:57.133410 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-19a6e303-4d46-460d-a79d-1c280b9ce012 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] [instance: d521fa69-4f04-4d79-8a81-22b2e4bafbae] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:15:57.188798 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-19a6e303-4d46-460d-a79d-1c280b9ce012 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c786544e8fb4e8e8c3a4990a0f36725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618cf0b3507845909bb27c13460d1d6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:15:57.195882 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-19a6e303-4d46-460d-a79d-1c280b9ce012 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] 10.222.0.27 "GET /compute/v2.1/servers/d521fa69-4f04-4d79-8a81-22b2e4bafbae" status: 200 len: 1240 microversion: 2.1 time: 0.067000 Oct 17 03:15:57.196554 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 310/586] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:15:57 2022] GET /compute/v2.1/servers/d521fa69-4f04-4d79-8a81-22b2e4bafbae => generated 1240 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:15:58.222924 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-168fc80c-3de6-4f87-9d13-452081340d9c tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:15:58.223576 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-168fc80c-3de6-4f87-9d13-452081340d9c tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] [instance: d521fa69-4f04-4d79-8a81-22b2e4bafbae] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:15:58.231334 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-168fc80c-3de6-4f87-9d13-452081340d9c tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:15:58.231818 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-168fc80c-3de6-4f87-9d13-452081340d9c tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:15:58.232252 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-168fc80c-3de6-4f87-9d13-452081340d9c tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:15:58.232946 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-168fc80c-3de6-4f87-9d13-452081340d9c tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:15:58.233787 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-168fc80c-3de6-4f87-9d13-452081340d9c tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:15:58.233787 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-168fc80c-3de6-4f87-9d13-452081340d9c tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:15:58.309024 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-168fc80c-3de6-4f87-9d13-452081340d9c tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c786544e8fb4e8e8c3a4990a0f36725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618cf0b3507845909bb27c13460d1d6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:15:58.316911 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-168fc80c-3de6-4f87-9d13-452081340d9c tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] 10.222.0.27 "GET /compute/v2.1/servers/d521fa69-4f04-4d79-8a81-22b2e4bafbae" status: 200 len: 1292 microversion: 2.1 time: 0.098191 Oct 17 03:15:58.317743 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 277/587] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:15:58 2022] GET /compute/v2.1/servers/d521fa69-4f04-4d79-8a81-22b2e4bafbae => generated 1292 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:15:59.342342 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-8c3fcf8a-7a45-4e20-ab13-c4e1b0e9fa3d tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:15:59.343300 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-8c3fcf8a-7a45-4e20-ab13-c4e1b0e9fa3d tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] [instance: d521fa69-4f04-4d79-8a81-22b2e4bafbae] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:15:59.350175 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-8c3fcf8a-7a45-4e20-ab13-c4e1b0e9fa3d tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:15:59.350843 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-8c3fcf8a-7a45-4e20-ab13-c4e1b0e9fa3d tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:15:59.351144 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-8c3fcf8a-7a45-4e20-ab13-c4e1b0e9fa3d tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:15:59.352310 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-8c3fcf8a-7a45-4e20-ab13-c4e1b0e9fa3d tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:15:59.353833 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-8c3fcf8a-7a45-4e20-ab13-c4e1b0e9fa3d tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:15:59.354445 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-8c3fcf8a-7a45-4e20-ab13-c4e1b0e9fa3d tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:15:59.494757 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-8c3fcf8a-7a45-4e20-ab13-c4e1b0e9fa3d tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c786544e8fb4e8e8c3a4990a0f36725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618cf0b3507845909bb27c13460d1d6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:15:59.504970 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-8c3fcf8a-7a45-4e20-ab13-c4e1b0e9fa3d tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] 10.222.0.27 "GET /compute/v2.1/servers/d521fa69-4f04-4d79-8a81-22b2e4bafbae" status: 200 len: 1364 microversion: 2.1 time: 0.167022 Oct 17 03:15:59.507133 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 311/588] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:15:59 2022] GET /compute/v2.1/servers/d521fa69-4f04-4d79-8a81-22b2e4bafbae => generated 1364 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:15:59.986162 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [req-74ba8bc2-f221-48c1-90f1-48f676d74a14 req-3da3fb49-a2ce-40fc-af60-398e0ae7fbd4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d521fa69-4f04-4d79-8a81-22b2e4bafbae", "tag": "3057284f-cd50-4b2a-8fd1-40b4a9779789"}]} {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:15:59.997024 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [req-74ba8bc2-f221-48c1-90f1-48f676d74a14 req-3da3fb49-a2ce-40fc-af60-398e0ae7fbd4 service nova] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:15:59.997535 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [req-74ba8bc2-f221-48c1-90f1-48f676d74a14 req-3da3fb49-a2ce-40fc-af60-398e0ae7fbd4 service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:15:59.998260 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [req-74ba8bc2-f221-48c1-90f1-48f676d74a14 req-3da3fb49-a2ce-40fc-af60-398e0ae7fbd4 service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:00.010640 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.compute.server_external_events [req-74ba8bc2-f221-48c1-90f1-48f676d74a14 req-3da3fb49-a2ce-40fc-af60-398e0ae7fbd4 service nova] Creating event network-changed:3057284f-cd50-4b2a-8fd1-40b4a9779789 for instance d521fa69-4f04-4d79-8a81-22b2e4bafbae on hv-cinder-84697 Oct 17 03:16:00.015661 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [req-74ba8bc2-f221-48c1-90f1-48f676d74a14 req-3da3fb49-a2ce-40fc-af60-398e0ae7fbd4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033190 Oct 17 03:16:00.016260 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 278/589] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 03:15:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:16:00.319111 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-788c9322-1bfb-4f7a-b38c-aa2b8e5cb030 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:16:00.321562 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-788c9322-1bfb-4f7a-b38c-aa2b8e5cb030 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: 712578d1-d2fb-4252-adbb-bc87096acc00] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:16:00.328589 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-788c9322-1bfb-4f7a-b38c-aa2b8e5cb030 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:00.329080 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-788c9322-1bfb-4f7a-b38c-aa2b8e5cb030 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:00.329522 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-788c9322-1bfb-4f7a-b38c-aa2b8e5cb030 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:00.330217 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-788c9322-1bfb-4f7a-b38c-aa2b8e5cb030 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:00.330672 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-788c9322-1bfb-4f7a-b38c-aa2b8e5cb030 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:00.331120 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-788c9322-1bfb-4f7a-b38c-aa2b8e5cb030 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:00.354637 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.objects.instance [None req-788c9322-1bfb-4f7a-b38c-aa2b8e5cb030 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lazy-loading 'flavor' on Instance uuid 712578d1-d2fb-4252-adbb-bc87096acc00 {{(pid=118886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 03:16:00.480277 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-788c9322-1bfb-4f7a-b38c-aa2b8e5cb030 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "POST /compute/v2.1/servers/712578d1-d2fb-4252-adbb-bc87096acc00/action" status: 200 len: 32 microversion: 2.1 time: 0.165427 Oct 17 03:16:00.480899 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 312/590] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 03:16:00 2022] POST /compute/v2.1/servers/712578d1-d2fb-4252-adbb-bc87096acc00/action => generated 32 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 03:16:00.490888 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-c9fa9a52-2403-4211-9137-ec5fabcd974c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:16:00.491577 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-c9fa9a52-2403-4211-9137-ec5fabcd974c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: 712578d1-d2fb-4252-adbb-bc87096acc00] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:16:00.498656 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-c9fa9a52-2403-4211-9137-ec5fabcd974c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:00.499167 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-c9fa9a52-2403-4211-9137-ec5fabcd974c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:00.499598 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-c9fa9a52-2403-4211-9137-ec5fabcd974c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:00.500275 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-c9fa9a52-2403-4211-9137-ec5fabcd974c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:00.500721 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-c9fa9a52-2403-4211-9137-ec5fabcd974c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:00.501139 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-c9fa9a52-2403-4211-9137-ec5fabcd974c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:00.529348 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-f4714a6c-0afb-4d4f-b0a7-87067c85fe3f tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:16:00.530072 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-f4714a6c-0afb-4d4f-b0a7-87067c85fe3f tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] [instance: d521fa69-4f04-4d79-8a81-22b2e4bafbae] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:16:00.536523 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-f4714a6c-0afb-4d4f-b0a7-87067c85fe3f tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:00.537046 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-f4714a6c-0afb-4d4f-b0a7-87067c85fe3f tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:00.537477 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-f4714a6c-0afb-4d4f-b0a7-87067c85fe3f tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:00.538177 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-f4714a6c-0afb-4d4f-b0a7-87067c85fe3f tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:00.538632 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-f4714a6c-0afb-4d4f-b0a7-87067c85fe3f tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:00.539085 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-f4714a6c-0afb-4d4f-b0a7-87067c85fe3f tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:00.630998 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-c9fa9a52-2403-4211-9137-ec5fabcd974c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1787a9ef7c44e28076aaa80c0152fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee21a91b84794e80b208fe72b7f1e010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:16:00.640072 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-c9fa9a52-2403-4211-9137-ec5fabcd974c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "GET /compute/v2.1/servers/712578d1-d2fb-4252-adbb-bc87096acc00" status: 200 len: 1735 microversion: 2.1 time: 0.153307 Oct 17 03:16:00.640637 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 279/591] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:16:00 2022] GET /compute/v2.1/servers/712578d1-d2fb-4252-adbb-bc87096acc00 => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:16:00.674175 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-f4714a6c-0afb-4d4f-b0a7-87067c85fe3f tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c786544e8fb4e8e8c3a4990a0f36725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618cf0b3507845909bb27c13460d1d6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:16:00.682336 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-f4714a6c-0afb-4d4f-b0a7-87067c85fe3f tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] 10.222.0.27 "GET /compute/v2.1/servers/d521fa69-4f04-4d79-8a81-22b2e4bafbae" status: 200 len: 1364 microversion: 2.1 time: 0.157139 Oct 17 03:16:00.682949 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 313/592] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:16:00 2022] GET /compute/v2.1/servers/d521fa69-4f04-4d79-8a81-22b2e4bafbae => generated 1364 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:16:00.995213 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-e36a85ba-03b4-4bb8-b996-55258b24e3b8 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:16:00.995734 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-e36a85ba-03b4-4bb8-b996-55258b24e3b8 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 603ee2bf-bedf-4688-ac0a-77a2a50f33d7] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:16:01.002286 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-e36a85ba-03b4-4bb8-b996-55258b24e3b8 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:01.002787 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-e36a85ba-03b4-4bb8-b996-55258b24e3b8 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:01.003399 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-e36a85ba-03b4-4bb8-b996-55258b24e3b8 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:01.004092 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-e36a85ba-03b4-4bb8-b996-55258b24e3b8 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:01.004541 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-e36a85ba-03b4-4bb8-b996-55258b24e3b8 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:01.004956 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-e36a85ba-03b4-4bb8-b996-55258b24e3b8 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:01.034454 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-e36a85ba-03b4-4bb8-b996-55258b24e3b8 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7/os-volume_attachments/f45fb229-2f3c-498d-a9c1-b264895c8a3e" status: 200 len: 194 microversion: 2.20 time: 0.043574 Oct 17 03:16:01.035047 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 280/593] 10.222.0.27 () {60 vars in 1454 bytes} [Mon Oct 17 03:16:00 2022] GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7/os-volume_attachments/f45fb229-2f3c-498d-a9c1-b264895c8a3e => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 03:16:01.102181 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-23ae2f9c-b99d-44cf-beaf-943e334dd6b4 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:16:01.102942 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-23ae2f9c-b99d-44cf-beaf-943e334dd6b4 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 603ee2bf-bedf-4688-ac0a-77a2a50f33d7] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:16:01.108742 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-23ae2f9c-b99d-44cf-beaf-943e334dd6b4 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:01.109214 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-23ae2f9c-b99d-44cf-beaf-943e334dd6b4 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:01.109641 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-23ae2f9c-b99d-44cf-beaf-943e334dd6b4 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:01.110318 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-23ae2f9c-b99d-44cf-beaf-943e334dd6b4 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:01.110761 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-23ae2f9c-b99d-44cf-beaf-943e334dd6b4 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:01.111253 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-23ae2f9c-b99d-44cf-beaf-943e334dd6b4 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:01.190430 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.objects.instance [None req-23ae2f9c-b99d-44cf-beaf-943e334dd6b4 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lazy-loading 'services' on Instance uuid 603ee2bf-bedf-4688-ac0a-77a2a50f33d7 {{(pid=118886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 03:16:01.193927 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG dbcounter [-] [118886] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:16:01.262058 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-23ae2f9c-b99d-44cf-beaf-943e334dd6b4 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "DELETE /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7/os-volume_attachments/f45fb229-2f3c-498d-a9c1-b264895c8a3e" status: 202 len: 0 microversion: 2.20 time: 0.163554 Oct 17 03:16:01.262662 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 314/594] 10.222.0.27 () {60 vars in 1457 bytes} [Mon Oct 17 03:16:01 2022] DELETE /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7/os-volume_attachments/f45fb229-2f3c-498d-a9c1-b264895c8a3e => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 17 03:16:01.271059 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-35761b62-39c1-4590-9c64-4b44c8913bbe tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:16:01.273373 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-35761b62-39c1-4590-9c64-4b44c8913bbe tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 603ee2bf-bedf-4688-ac0a-77a2a50f33d7] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:16:01.280034 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-35761b62-39c1-4590-9c64-4b44c8913bbe tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:01.280514 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-35761b62-39c1-4590-9c64-4b44c8913bbe tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:01.280941 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-35761b62-39c1-4590-9c64-4b44c8913bbe tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:01.282204 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-35761b62-39c1-4590-9c64-4b44c8913bbe tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:01.282356 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-35761b62-39c1-4590-9c64-4b44c8913bbe tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:01.282798 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-35761b62-39c1-4590-9c64-4b44c8913bbe tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:01.299932 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG dbcounter [-] [118887] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=118887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:16:01.315287 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-35761b62-39c1-4590-9c64-4b44c8913bbe tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048148 Oct 17 03:16:01.315836 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 281/595] 10.222.0.27 () {60 vars in 1343 bytes} [Mon Oct 17 03:16:01 2022] GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 03:16:01.664698 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-83798338-08ef-4066-a3e6-52b0a7aa0ebf tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:16:01.666068 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-83798338-08ef-4066-a3e6-52b0a7aa0ebf tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: 712578d1-d2fb-4252-adbb-bc87096acc00] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:16:01.672552 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-83798338-08ef-4066-a3e6-52b0a7aa0ebf tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:01.673036 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-83798338-08ef-4066-a3e6-52b0a7aa0ebf tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:01.673492 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-83798338-08ef-4066-a3e6-52b0a7aa0ebf tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:01.674188 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-83798338-08ef-4066-a3e6-52b0a7aa0ebf tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:01.674632 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-83798338-08ef-4066-a3e6-52b0a7aa0ebf tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:01.675077 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-83798338-08ef-4066-a3e6-52b0a7aa0ebf tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:01.705189 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-9bcb5571-0a25-4fef-86bb-804b8c716e64 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:16:01.706168 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-9bcb5571-0a25-4fef-86bb-804b8c716e64 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] [instance: d521fa69-4f04-4d79-8a81-22b2e4bafbae] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:16:01.712848 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-9bcb5571-0a25-4fef-86bb-804b8c716e64 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:01.713332 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-9bcb5571-0a25-4fef-86bb-804b8c716e64 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:01.713763 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-9bcb5571-0a25-4fef-86bb-804b8c716e64 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:01.714462 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-9bcb5571-0a25-4fef-86bb-804b8c716e64 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:01.715154 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-9bcb5571-0a25-4fef-86bb-804b8c716e64 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:01.715932 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-9bcb5571-0a25-4fef-86bb-804b8c716e64 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:01.810447 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-83798338-08ef-4066-a3e6-52b0a7aa0ebf tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1787a9ef7c44e28076aaa80c0152fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee21a91b84794e80b208fe72b7f1e010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:16:01.820025 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-83798338-08ef-4066-a3e6-52b0a7aa0ebf tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "GET /compute/v2.1/servers/712578d1-d2fb-4252-adbb-bc87096acc00" status: 200 len: 1735 microversion: 2.1 time: 0.159998 Oct 17 03:16:01.820603 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 315/596] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:16:01 2022] GET /compute/v2.1/servers/712578d1-d2fb-4252-adbb-bc87096acc00 => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:16:01.992449 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-9bcb5571-0a25-4fef-86bb-804b8c716e64 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c786544e8fb4e8e8c3a4990a0f36725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618cf0b3507845909bb27c13460d1d6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:16:02.000890 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-9bcb5571-0a25-4fef-86bb-804b8c716e64 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] 10.222.0.27 "GET /compute/v2.1/servers/d521fa69-4f04-4d79-8a81-22b2e4bafbae" status: 200 len: 1364 microversion: 2.1 time: 0.299688 Oct 17 03:16:02.001565 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 282/597] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:16:01 2022] GET /compute/v2.1/servers/d521fa69-4f04-4d79-8a81-22b2e4bafbae => generated 1364 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:16:02.328718 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-cd005635-4621-4229-8ccf-dd76bf292ed8 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:16:02.331201 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-cd005635-4621-4229-8ccf-dd76bf292ed8 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 603ee2bf-bedf-4688-ac0a-77a2a50f33d7] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:16:02.337909 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-cd005635-4621-4229-8ccf-dd76bf292ed8 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:02.338404 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-cd005635-4621-4229-8ccf-dd76bf292ed8 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:02.338838 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-cd005635-4621-4229-8ccf-dd76bf292ed8 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:02.339566 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-cd005635-4621-4229-8ccf-dd76bf292ed8 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:02.340018 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-cd005635-4621-4229-8ccf-dd76bf292ed8 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:02.340439 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-cd005635-4621-4229-8ccf-dd76bf292ed8 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:02.371669 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-cd005635-4621-4229-8ccf-dd76bf292ed8 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.046976 Oct 17 03:16:02.378067 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 316/598] 10.222.0.27 () {60 vars in 1343 bytes} [Mon Oct 17 03:16:02 2022] GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:16:02.441352 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-db95dbc9-0f4b-437a-9ef8-1d6863238024 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:16:02.441854 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-db95dbc9-0f4b-437a-9ef8-1d6863238024 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 603ee2bf-bedf-4688-ac0a-77a2a50f33d7] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:16:02.448820 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-db95dbc9-0f4b-437a-9ef8-1d6863238024 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:02.449560 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-db95dbc9-0f4b-437a-9ef8-1d6863238024 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:02.450094 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-db95dbc9-0f4b-437a-9ef8-1d6863238024 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:02.450810 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-db95dbc9-0f4b-437a-9ef8-1d6863238024 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:02.451295 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-db95dbc9-0f4b-437a-9ef8-1d6863238024 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:02.451721 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-db95dbc9-0f4b-437a-9ef8-1d6863238024 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:02.480445 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-db95dbc9-0f4b-437a-9ef8-1d6863238024 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 603ee2bf-bedf-4688-ac0a-77a2a50f33d7] Going to try to terminate instance {{(pid=118887) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 03:16:02.565548 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-db95dbc9-0f4b-437a-9ef8-1d6863238024 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "DELETE /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7" status: 204 len: 0 microversion: 2.20 time: 0.127614 Oct 17 03:16:02.566143 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 283/599] 10.222.0.27 () {60 vars in 1280 bytes} [Mon Oct 17 03:16:02 2022] DELETE /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 17 03:16:02.575958 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-bfa040d6-e6d7-4a0f-9788-363110d381d1 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:16:02.576566 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-bfa040d6-e6d7-4a0f-9788-363110d381d1 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 603ee2bf-bedf-4688-ac0a-77a2a50f33d7] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:16:02.582917 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-bfa040d6-e6d7-4a0f-9788-363110d381d1 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:02.583405 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-bfa040d6-e6d7-4a0f-9788-363110d381d1 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:02.583835 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-bfa040d6-e6d7-4a0f-9788-363110d381d1 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:02.584525 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-bfa040d6-e6d7-4a0f-9788-363110d381d1 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:02.584975 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-bfa040d6-e6d7-4a0f-9788-363110d381d1 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:02.585393 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-bfa040d6-e6d7-4a0f-9788-363110d381d1 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:02.716425 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-bfa040d6-e6d7-4a0f-9788-363110d381d1 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:16:02.724640 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-bfa040d6-e6d7-4a0f-9788-363110d381d1 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:16:02.726063 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-bfa040d6-e6d7-4a0f-9788-363110d381d1 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:16:02.727241 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-bfa040d6-e6d7-4a0f-9788-363110d381d1 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7" status: 200 len: 1724 microversion: 2.20 time: 0.156029 Oct 17 03:16:02.728014 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 317/600] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 03:16:02 2022] GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:16:02.843477 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-a636be80-12f0-4cfa-8d64-18ee584e3ad6 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:16:02.844279 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-a636be80-12f0-4cfa-8d64-18ee584e3ad6 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: 712578d1-d2fb-4252-adbb-bc87096acc00] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:16:02.850145 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-a636be80-12f0-4cfa-8d64-18ee584e3ad6 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:02.850628 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-a636be80-12f0-4cfa-8d64-18ee584e3ad6 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:02.851110 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-a636be80-12f0-4cfa-8d64-18ee584e3ad6 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:02.851805 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-a636be80-12f0-4cfa-8d64-18ee584e3ad6 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:02.852265 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-a636be80-12f0-4cfa-8d64-18ee584e3ad6 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:02.852915 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-a636be80-12f0-4cfa-8d64-18ee584e3ad6 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:02.984913 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-a636be80-12f0-4cfa-8d64-18ee584e3ad6 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1787a9ef7c44e28076aaa80c0152fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee21a91b84794e80b208fe72b7f1e010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:16:02.993564 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-a636be80-12f0-4cfa-8d64-18ee584e3ad6 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "GET /compute/v2.1/servers/712578d1-d2fb-4252-adbb-bc87096acc00" status: 200 len: 1735 microversion: 2.1 time: 0.153960 Oct 17 03:16:02.994590 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 284/601] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:16:02 2022] GET /compute/v2.1/servers/712578d1-d2fb-4252-adbb-bc87096acc00 => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:16:03.022988 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-a25d8f07-c037-4d03-bf06-1fdb1b28a694 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:16:03.023596 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-a25d8f07-c037-4d03-bf06-1fdb1b28a694 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] [instance: d521fa69-4f04-4d79-8a81-22b2e4bafbae] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:16:03.029505 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-a25d8f07-c037-4d03-bf06-1fdb1b28a694 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:03.029977 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-a25d8f07-c037-4d03-bf06-1fdb1b28a694 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:03.030400 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-a25d8f07-c037-4d03-bf06-1fdb1b28a694 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:03.031111 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-a25d8f07-c037-4d03-bf06-1fdb1b28a694 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:03.031558 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-a25d8f07-c037-4d03-bf06-1fdb1b28a694 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:03.031975 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-a25d8f07-c037-4d03-bf06-1fdb1b28a694 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:03.161104 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-a25d8f07-c037-4d03-bf06-1fdb1b28a694 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c786544e8fb4e8e8c3a4990a0f36725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618cf0b3507845909bb27c13460d1d6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:16:03.169900 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-a25d8f07-c037-4d03-bf06-1fdb1b28a694 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] 10.222.0.27 "GET /compute/v2.1/servers/d521fa69-4f04-4d79-8a81-22b2e4bafbae" status: 200 len: 1364 microversion: 2.1 time: 0.150715 Oct 17 03:16:03.170488 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 318/602] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:16:03 2022] GET /compute/v2.1/servers/d521fa69-4f04-4d79-8a81-22b2e4bafbae => generated 1364 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:16:03.753707 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-af82f980-74cc-4261-9e30-35c576417f3a tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:16:03.754292 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-af82f980-74cc-4261-9e30-35c576417f3a tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 603ee2bf-bedf-4688-ac0a-77a2a50f33d7] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:16:03.761853 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-af82f980-74cc-4261-9e30-35c576417f3a tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:03.762415 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-af82f980-74cc-4261-9e30-35c576417f3a tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:03.762968 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-af82f980-74cc-4261-9e30-35c576417f3a tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:03.763739 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-af82f980-74cc-4261-9e30-35c576417f3a tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:03.764190 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-af82f980-74cc-4261-9e30-35c576417f3a tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:03.764611 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-af82f980-74cc-4261-9e30-35c576417f3a tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:03.894308 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-af82f980-74cc-4261-9e30-35c576417f3a tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:16:03.903121 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-af82f980-74cc-4261-9e30-35c576417f3a tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:16:03.904578 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-af82f980-74cc-4261-9e30-35c576417f3a tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:16:03.905731 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-af82f980-74cc-4261-9e30-35c576417f3a tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7" status: 200 len: 1724 microversion: 2.20 time: 0.156007 Oct 17 03:16:03.906281 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 285/603] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 03:16:03 2022] GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:16:04.017418 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-1cfaae32-0fd9-4338-aa1c-26916f7e7499 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:16:04.017953 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-1cfaae32-0fd9-4338-aa1c-26916f7e7499 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: 712578d1-d2fb-4252-adbb-bc87096acc00] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:16:04.025407 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-1cfaae32-0fd9-4338-aa1c-26916f7e7499 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:04.025896 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-1cfaae32-0fd9-4338-aa1c-26916f7e7499 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:04.026334 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-1cfaae32-0fd9-4338-aa1c-26916f7e7499 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:04.027063 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-1cfaae32-0fd9-4338-aa1c-26916f7e7499 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:04.027527 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-1cfaae32-0fd9-4338-aa1c-26916f7e7499 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:04.027955 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-1cfaae32-0fd9-4338-aa1c-26916f7e7499 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:04.156817 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-1cfaae32-0fd9-4338-aa1c-26916f7e7499 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1787a9ef7c44e28076aaa80c0152fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee21a91b84794e80b208fe72b7f1e010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:16:04.165457 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-1cfaae32-0fd9-4338-aa1c-26916f7e7499 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "GET /compute/v2.1/servers/712578d1-d2fb-4252-adbb-bc87096acc00" status: 200 len: 1735 microversion: 2.1 time: 0.151895 Oct 17 03:16:04.166019 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 319/604] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:16:04 2022] GET /compute/v2.1/servers/712578d1-d2fb-4252-adbb-bc87096acc00 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:16:04.193257 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-5c5c7038-7a00-4316-9881-983b451b1c61 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:16:04.193897 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-5c5c7038-7a00-4316-9881-983b451b1c61 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] [instance: d521fa69-4f04-4d79-8a81-22b2e4bafbae] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:16:04.200416 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-5c5c7038-7a00-4316-9881-983b451b1c61 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:04.200901 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-5c5c7038-7a00-4316-9881-983b451b1c61 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:04.201340 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-5c5c7038-7a00-4316-9881-983b451b1c61 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:04.202031 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-5c5c7038-7a00-4316-9881-983b451b1c61 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:04.202484 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-5c5c7038-7a00-4316-9881-983b451b1c61 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:04.202933 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-5c5c7038-7a00-4316-9881-983b451b1c61 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:04.429079 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-5c5c7038-7a00-4316-9881-983b451b1c61 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c786544e8fb4e8e8c3a4990a0f36725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618cf0b3507845909bb27c13460d1d6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:16:04.438213 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-5c5c7038-7a00-4316-9881-983b451b1c61 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] 10.222.0.27 "GET /compute/v2.1/servers/d521fa69-4f04-4d79-8a81-22b2e4bafbae" status: 200 len: 1364 microversion: 2.1 time: 0.248548 Oct 17 03:16:04.439087 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 286/605] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:16:04 2022] GET /compute/v2.1/servers/d521fa69-4f04-4d79-8a81-22b2e4bafbae => generated 1364 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:16:04.476604 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [req-52c577b5-70eb-40b5-b12c-c94d6aa27534 req-f8968299-5a64-4dbc-bd11-b0290bd48ea1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d521fa69-4f04-4d79-8a81-22b2e4bafbae", "name": "network-vif-plugged", "status": "completed", "tag": "3057284f-cd50-4b2a-8fd1-40b4a9779789"}]} {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:16:04.487597 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [req-52c577b5-70eb-40b5-b12c-c94d6aa27534 req-f8968299-5a64-4dbc-bd11-b0290bd48ea1 service nova] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:04.488346 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [req-52c577b5-70eb-40b5-b12c-c94d6aa27534 req-f8968299-5a64-4dbc-bd11-b0290bd48ea1 service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:04.488880 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [req-52c577b5-70eb-40b5-b12c-c94d6aa27534 req-f8968299-5a64-4dbc-bd11-b0290bd48ea1 service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:04.501708 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.compute.server_external_events [req-52c577b5-70eb-40b5-b12c-c94d6aa27534 req-f8968299-5a64-4dbc-bd11-b0290bd48ea1 service nova] Creating event network-vif-plugged:3057284f-cd50-4b2a-8fd1-40b4a9779789 for instance d521fa69-4f04-4d79-8a81-22b2e4bafbae on hv-cinder-84697 Oct 17 03:16:04.506757 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [req-52c577b5-70eb-40b5-b12c-c94d6aa27534 req-f8968299-5a64-4dbc-bd11-b0290bd48ea1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034346 Oct 17 03:16:04.507728 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 320/606] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 03:16:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:16:04.931993 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-ecad6c14-08be-43db-8cef-5666606c6a83 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:16:04.932601 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-ecad6c14-08be-43db-8cef-5666606c6a83 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 603ee2bf-bedf-4688-ac0a-77a2a50f33d7] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:16:04.939290 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-ecad6c14-08be-43db-8cef-5666606c6a83 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:04.939778 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-ecad6c14-08be-43db-8cef-5666606c6a83 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:04.940208 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-ecad6c14-08be-43db-8cef-5666606c6a83 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:04.941091 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-ecad6c14-08be-43db-8cef-5666606c6a83 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:04.941555 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-ecad6c14-08be-43db-8cef-5666606c6a83 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:04.941979 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-ecad6c14-08be-43db-8cef-5666606c6a83 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:05.017055 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-ecad6c14-08be-43db-8cef-5666606c6a83 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:16:05.025922 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-ecad6c14-08be-43db-8cef-5666606c6a83 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:16:05.027390 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-ecad6c14-08be-43db-8cef-5666606c6a83 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:16:05.028543 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-ecad6c14-08be-43db-8cef-5666606c6a83 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7" status: 200 len: 1656 microversion: 2.20 time: 0.100887 Oct 17 03:16:05.029108 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 287/607] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 03:16:04 2022] GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7 => generated 1656 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:16:05.189738 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-fad25dd4-f4c3-49c1-bd26-f743ef41f909 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:16:05.191020 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-fad25dd4-f4c3-49c1-bd26-f743ef41f909 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: 712578d1-d2fb-4252-adbb-bc87096acc00] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:16:05.198299 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-fad25dd4-f4c3-49c1-bd26-f743ef41f909 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:05.199252 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-fad25dd4-f4c3-49c1-bd26-f743ef41f909 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:05.199628 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-fad25dd4-f4c3-49c1-bd26-f743ef41f909 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:05.200330 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-fad25dd4-f4c3-49c1-bd26-f743ef41f909 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:05.200935 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-fad25dd4-f4c3-49c1-bd26-f743ef41f909 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:05.201510 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-fad25dd4-f4c3-49c1-bd26-f743ef41f909 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:05.247492 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [req-d382dfde-1501-432d-b80b-e4ca9b167398 req-1e0efd9e-af68-480a-8faa-5bf1a223821e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "603ee2bf-bedf-4688-ac0a-77a2a50f33d7", "name": "network-vif-deleted", "tag": "faf2315a-88ad-4367-997b-65c1cf0209ee"}]} {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:16:05.259100 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [req-d382dfde-1501-432d-b80b-e4ca9b167398 req-1e0efd9e-af68-480a-8faa-5bf1a223821e service nova] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:05.259906 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [req-d382dfde-1501-432d-b80b-e4ca9b167398 req-1e0efd9e-af68-480a-8faa-5bf1a223821e service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:05.260555 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [req-d382dfde-1501-432d-b80b-e4ca9b167398 req-1e0efd9e-af68-480a-8faa-5bf1a223821e service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:05.273456 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.compute.server_external_events [req-d382dfde-1501-432d-b80b-e4ca9b167398 req-1e0efd9e-af68-480a-8faa-5bf1a223821e service nova] Creating event network-vif-deleted:faf2315a-88ad-4367-997b-65c1cf0209ee for instance 603ee2bf-bedf-4688-ac0a-77a2a50f33d7 on hv-cinder-84697 Oct 17 03:16:05.281020 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [req-d382dfde-1501-432d-b80b-e4ca9b167398 req-1e0efd9e-af68-480a-8faa-5bf1a223821e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037760 Oct 17 03:16:05.282283 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 288/608] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 03:16:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:16:05.377937 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-fad25dd4-f4c3-49c1-bd26-f743ef41f909 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1787a9ef7c44e28076aaa80c0152fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee21a91b84794e80b208fe72b7f1e010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:16:05.387316 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-fad25dd4-f4c3-49c1-bd26-f743ef41f909 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "GET /compute/v2.1/servers/712578d1-d2fb-4252-adbb-bc87096acc00" status: 200 len: 1735 microversion: 2.1 time: 0.201603 Oct 17 03:16:05.388471 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 321/609] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:16:05 2022] GET /compute/v2.1/servers/712578d1-d2fb-4252-adbb-bc87096acc00 => generated 1735 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:16:05.464387 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-1b7b4d98-5687-44ae-9710-8f98d61cc841 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:16:05.465436 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-1b7b4d98-5687-44ae-9710-8f98d61cc841 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] [instance: d521fa69-4f04-4d79-8a81-22b2e4bafbae] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:16:05.472021 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-1b7b4d98-5687-44ae-9710-8f98d61cc841 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:05.472506 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-1b7b4d98-5687-44ae-9710-8f98d61cc841 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:05.472946 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-1b7b4d98-5687-44ae-9710-8f98d61cc841 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:05.473659 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-1b7b4d98-5687-44ae-9710-8f98d61cc841 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:05.474114 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-1b7b4d98-5687-44ae-9710-8f98d61cc841 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:05.474543 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-1b7b4d98-5687-44ae-9710-8f98d61cc841 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:05.613932 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-1b7b4d98-5687-44ae-9710-8f98d61cc841 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c786544e8fb4e8e8c3a4990a0f36725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618cf0b3507845909bb27c13460d1d6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:16:05.622484 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-1b7b4d98-5687-44ae-9710-8f98d61cc841 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] 10.222.0.27 "GET /compute/v2.1/servers/d521fa69-4f04-4d79-8a81-22b2e4bafbae" status: 200 len: 1364 microversion: 2.1 time: 0.162711 Oct 17 03:16:05.634705 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 289/610] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:16:05 2022] GET /compute/v2.1/servers/d521fa69-4f04-4d79-8a81-22b2e4bafbae => generated 1364 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:16:06.054748 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-0e10cb58-1ca7-440e-b7d2-abe6d7503289 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:16:06.055390 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-0e10cb58-1ca7-440e-b7d2-abe6d7503289 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 603ee2bf-bedf-4688-ac0a-77a2a50f33d7] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:16:06.061714 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-0e10cb58-1ca7-440e-b7d2-abe6d7503289 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:06.062196 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-0e10cb58-1ca7-440e-b7d2-abe6d7503289 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:06.062626 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-0e10cb58-1ca7-440e-b7d2-abe6d7503289 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:06.063353 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-0e10cb58-1ca7-440e-b7d2-abe6d7503289 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:06.063803 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-0e10cb58-1ca7-440e-b7d2-abe6d7503289 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:06.064216 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-0e10cb58-1ca7-440e-b7d2-abe6d7503289 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:06.096287 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-0e10cb58-1ca7-440e-b7d2-abe6d7503289 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:06.096764 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-0e10cb58-1ca7-440e-b7d2-abe6d7503289 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:06.097220 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-0e10cb58-1ca7-440e-b7d2-abe6d7503289 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:06.097656 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.objects.instance [None req-0e10cb58-1ca7-440e-b7d2-abe6d7503289 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lazy-loading 'fault' on Instance uuid 603ee2bf-bedf-4688-ac0a-77a2a50f33d7 {{(pid=118886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 03:16:06.138698 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-0e10cb58-1ca7-440e-b7d2-abe6d7503289 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:16:06.147079 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-0e10cb58-1ca7-440e-b7d2-abe6d7503289 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:16:06.148512 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-0e10cb58-1ca7-440e-b7d2-abe6d7503289 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:16:06.150206 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-0e10cb58-1ca7-440e-b7d2-abe6d7503289 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7" status: 200 len: 1371 microversion: 2.20 time: 0.098854 Oct 17 03:16:06.150859 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 322/611] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 03:16:06 2022] GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7 => generated 1371 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:16:06.411341 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-71e778f2-de06-436d-9874-70bcdfddf8fb tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:16:06.411949 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-71e778f2-de06-436d-9874-70bcdfddf8fb tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: 712578d1-d2fb-4252-adbb-bc87096acc00] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:16:06.419035 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-71e778f2-de06-436d-9874-70bcdfddf8fb tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:06.419566 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-71e778f2-de06-436d-9874-70bcdfddf8fb tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:06.420112 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-71e778f2-de06-436d-9874-70bcdfddf8fb tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:06.420921 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-71e778f2-de06-436d-9874-70bcdfddf8fb tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:06.422140 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-71e778f2-de06-436d-9874-70bcdfddf8fb tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:06.423356 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-71e778f2-de06-436d-9874-70bcdfddf8fb tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:06.561153 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-71e778f2-de06-436d-9874-70bcdfddf8fb tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1787a9ef7c44e28076aaa80c0152fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee21a91b84794e80b208fe72b7f1e010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:16:06.569330 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-71e778f2-de06-436d-9874-70bcdfddf8fb tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "GET /compute/v2.1/servers/712578d1-d2fb-4252-adbb-bc87096acc00" status: 200 len: 1735 microversion: 2.1 time: 0.162410 Oct 17 03:16:06.569890 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 290/612] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:16:06 2022] GET /compute/v2.1/servers/712578d1-d2fb-4252-adbb-bc87096acc00 => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:16:06.644709 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-3de9b41d-b308-4131-b3f3-3fdcee2c5a86 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:16:06.645340 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-3de9b41d-b308-4131-b3f3-3fdcee2c5a86 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] [instance: d521fa69-4f04-4d79-8a81-22b2e4bafbae] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:16:06.651791 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-3de9b41d-b308-4131-b3f3-3fdcee2c5a86 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:06.652271 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-3de9b41d-b308-4131-b3f3-3fdcee2c5a86 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:06.652704 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-3de9b41d-b308-4131-b3f3-3fdcee2c5a86 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:06.653382 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-3de9b41d-b308-4131-b3f3-3fdcee2c5a86 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:06.653829 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-3de9b41d-b308-4131-b3f3-3fdcee2c5a86 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:06.654252 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-3de9b41d-b308-4131-b3f3-3fdcee2c5a86 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:06.786082 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-3de9b41d-b308-4131-b3f3-3fdcee2c5a86 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c786544e8fb4e8e8c3a4990a0f36725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618cf0b3507845909bb27c13460d1d6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:16:06.794695 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-3de9b41d-b308-4131-b3f3-3fdcee2c5a86 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] 10.222.0.27 "GET /compute/v2.1/servers/d521fa69-4f04-4d79-8a81-22b2e4bafbae" status: 200 len: 1554 microversion: 2.1 time: 0.153746 Oct 17 03:16:06.795293 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 323/613] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:16:06 2022] GET /compute/v2.1/servers/d521fa69-4f04-4d79-8a81-22b2e4bafbae => generated 1554 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:16:06.817631 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-a2f4ec73-aaac-4246-80d4-a0f8de9557b6 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:16:06.818245 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-a2f4ec73-aaac-4246-80d4-a0f8de9557b6 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] [instance: d521fa69-4f04-4d79-8a81-22b2e4bafbae] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:16:06.825580 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-a2f4ec73-aaac-4246-80d4-a0f8de9557b6 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:06.826235 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-a2f4ec73-aaac-4246-80d4-a0f8de9557b6 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:06.826755 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-a2f4ec73-aaac-4246-80d4-a0f8de9557b6 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:06.827681 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-a2f4ec73-aaac-4246-80d4-a0f8de9557b6 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:06.828265 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-a2f4ec73-aaac-4246-80d4-a0f8de9557b6 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:06.828871 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-a2f4ec73-aaac-4246-80d4-a0f8de9557b6 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:06.906405 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-a2f4ec73-aaac-4246-80d4-a0f8de9557b6 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] 10.222.0.27 "GET /compute/v2.1/servers/d521fa69-4f04-4d79-8a81-22b2e4bafbae/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092161 Oct 17 03:16:06.907349 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 291/614] 10.222.0.27 () {58 vars in 1275 bytes} [Mon Oct 17 03:16:06 2022] GET /compute/v2.1/servers/d521fa69-4f04-4d79-8a81-22b2e4bafbae/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:16:07.176118 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-8b05d834-04db-42f5-8982-51580072f964 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:16:07.176725 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-8b05d834-04db-42f5-8982-51580072f964 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 603ee2bf-bedf-4688-ac0a-77a2a50f33d7] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:16:07.182991 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-8b05d834-04db-42f5-8982-51580072f964 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:07.183477 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-8b05d834-04db-42f5-8982-51580072f964 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:07.183914 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-8b05d834-04db-42f5-8982-51580072f964 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:07.184605 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-8b05d834-04db-42f5-8982-51580072f964 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:07.185052 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-8b05d834-04db-42f5-8982-51580072f964 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:07.185474 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-8b05d834-04db-42f5-8982-51580072f964 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:07.198122 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG dbcounter [-] [118886] Writing DB stats nova_cell0:SELECT=6 {{(pid=118886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:16:07.199945 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.wsgi [None req-8b05d834-04db-42f5-8982-51580072f964 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] HTTP exception thrown: Instance 603ee2bf-bedf-4688-ac0a-77a2a50f33d7 could not be found. Oct 17 03:16:07.201674 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-8b05d834-04db-42f5-8982-51580072f964 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Request method failure captured: Oct 17 03:16:07.201674 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: request: GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7 HTTP/1.1 Oct 17 03:16:07.201674 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Accept: application/json Oct 17 03:16:07.201674 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Accept-Encoding: identity Oct 17 03:16:07.201674 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Connection: close Oct 17 03:16:07.201674 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Content-Length: 0 Oct 17 03:16:07.201674 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Content-Type: application/json Oct 17 03:16:07.201674 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Host: 10.222.0.27 Oct 17 03:16:07.201674 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Openstack-System-Scope: None Oct 17 03:16:07.201674 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: User-Agent: python-urllib3/1.26.12 Oct 17 03:16:07.201674 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Auth-Token: gAAAAABjTMfzbKpbt0kOvVu86awv7-V-P59rVIKzQXyrGYlIS0TDAu_L9nhz3LW4BwaRLYShAEIVkXljDizTTsY986WBJQpfs_bFugN6hZoUM4zgN1nzkmnJ89mooLiSyLaBYdxbhQH-jJVO_iyWb4c9To6TMVUwiRACKGKE9VaiqOkgtBJd-VI Oct 17 03:16:07.201674 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Domain-Id: None Oct 17 03:16:07.201674 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Domain-Name: None Oct 17 03:16:07.201674 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Identity-Status: Confirmed Oct 17 03:16:07.201674 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Is-Admin-Project: True Oct 17 03:16:07.201674 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Openstack-Nova-Api-Version: 2.20 Oct 17 03:16:07.201674 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Project-Domain-Id: default Oct 17 03:16:07.201674 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Project-Domain-Name: Default Oct 17 03:16:07.201674 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Project-Id: 36f63b28bb4f4654b53a01507b337d52 Oct 17 03:16:07.201674 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-957531208 Oct 17 03:16:07.201674 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Role: member,reader Oct 17 03:16:07.201674 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Roles: member,reader Oct 17 03:16:07.203298 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/36f63b28bb4f4654b53a01507b337d52"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/36f63b28bb4f4654b53a01507b337d52"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/36f63b28bb4f4654b53a01507b337d52"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_36f63b28bb4f4654b53a01507b337d52"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 17 03:16:07.203298 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Tenant: tempest-AttachVolumeShelveTestJSON-957531208 Oct 17 03:16:07.203298 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Tenant-Id: 36f63b28bb4f4654b53a01507b337d52 Oct 17 03:16:07.203298 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-957531208 Oct 17 03:16:07.203298 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-User: tempest-AttachVolumeShelveTestJSON-957531208-project Oct 17 03:16:07.203298 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-User-Domain-Id: default Oct 17 03:16:07.203298 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-User-Domain-Name: Default Oct 17 03:16:07.203298 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-User-Id: 37e6d36d529146299970874660e92e43 Oct 17 03:16:07.203298 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-User-Name: tempest-AttachVolumeShelveTestJSON-957531208-project Oct 17 03:16:07.203298 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: method: > Oct 17 03:16:07.203298 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: exception: Instance 603ee2bf-bedf-4688-ac0a-77a2a50f33d7 could not be found. Oct 17 03:16:07.203298 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: action_args: {'id': '603ee2bf-bedf-4688-ac0a-77a2a50f33d7'} Oct 17 03:16:07.204175 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 03:16:07.204175 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:16:07.204175 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 03:16:07.204175 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 03:16:07.204175 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 03:16:07.204175 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 03:16:07.204175 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 03:16:07.204175 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 03:16:07.204175 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 03:16:07.204175 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 03:16:07.204175 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 603ee2bf-bedf-4688-ac0a-77a2a50f33d7 could not be found. Oct 17 03:16:07.204175 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Oct 17 03:16:07.204175 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:16:07.204175 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Oct 17 03:16:07.204175 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:16:07.204175 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:16:07.204175 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:16:07.204175 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 03:16:07.204175 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 03:16:07.204175 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 03:16:07.205530 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 03:16:07.205530 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 03:16:07.205530 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 03:16:07.205530 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 03:16:07.205530 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 03:16:07.205530 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 03:16:07.205530 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 03:16:07.205530 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 603ee2bf-bedf-4688-ac0a-77a2a50f33d7 could not be found. Oct 17 03:16:07.205530 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Oct 17 03:16:07.205530 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:16:07.205530 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Oct 17 03:16:07.205530 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:16:07.205530 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:16:07.205530 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:16:07.205530 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 03:16:07.205530 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 03:16:07.205530 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 603ee2bf-bedf-4688-ac0a-77a2a50f33d7 could not be found. Oct 17 03:16:07.205530 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Oct 17 03:16:07.206742 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-8b05d834-04db-42f5-8982-51580072f964 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Returning 404 to user: Instance 603ee2bf-bedf-4688-ac0a-77a2a50f33d7 could not be found. {{(pid=118886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 03:16:07.206742 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-8b05d834-04db-42f5-8982-51580072f964 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7" status: 404 len: 111 microversion: 2.20 time: 0.030921 Oct 17 03:16:07.206742 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 324/615] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 03:16:07 2022] GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 17 03:16:07.208994 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG dbcounter [-] [118887] Writing DB stats nova_cell0:SELECT=2 {{(pid=118887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:16:07.209757 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG dbcounter [-] [118887] Writing DB stats nova_cell0:SELECT=6 {{(pid=118887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:16:07.217349 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-653aa796-b86e-439b-b4b1-abb5c5df65e3 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '.version_select at 0x7fc70176d940>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:16:07.234699 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-653aa796-b86e-439b-b4b1-abb5c5df65e3 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1868694485" status: 204 len: 0 microversion: 2.20 time: 0.026451 Oct 17 03:16:07.238982 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 292/616] 10.222.0.27 () {60 vars in 1262 bytes} [Mon Oct 17 03:16:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1868694485 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 17 03:16:07.593077 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-f8e0e8b8-abd4-46e0-b9de-d99253ce5357 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:16:07.594043 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-f8e0e8b8-abd4-46e0-b9de-d99253ce5357 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: 712578d1-d2fb-4252-adbb-bc87096acc00] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:16:07.601491 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-f8e0e8b8-abd4-46e0-b9de-d99253ce5357 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:07.602111 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-f8e0e8b8-abd4-46e0-b9de-d99253ce5357 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:07.603338 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-f8e0e8b8-abd4-46e0-b9de-d99253ce5357 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:07.604157 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-f8e0e8b8-abd4-46e0-b9de-d99253ce5357 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:07.604710 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-f8e0e8b8-abd4-46e0-b9de-d99253ce5357 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:07.605349 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-f8e0e8b8-abd4-46e0-b9de-d99253ce5357 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:07.813596 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-f8e0e8b8-abd4-46e0-b9de-d99253ce5357 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1787a9ef7c44e28076aaa80c0152fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee21a91b84794e80b208fe72b7f1e010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:16:07.824278 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-f8e0e8b8-abd4-46e0-b9de-d99253ce5357 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "GET /compute/v2.1/servers/712578d1-d2fb-4252-adbb-bc87096acc00" status: 200 len: 1735 microversion: 2.1 time: 0.235582 Oct 17 03:16:07.825219 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 325/617] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:16:07 2022] GET /compute/v2.1/servers/712578d1-d2fb-4252-adbb-bc87096acc00 => generated 1735 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:16:07.937634 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-984c423c-6348-4c3c-8990-ed2dbc5f9fe9 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Action: 'create', calling method: .version_select at 0x7fc7017dd040>, body: {"keypair": {"name": "tempest-keypair-988862253", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAEZf4EoFLnTPRGQ0EU9LuIst2tD6D7bv8P5GDckdXFX69z6K07H4mz2GnMwE3BIuBTLnd3KN1IHMr/94Buk5yNpkDCeN5TXFb9KlqELLA+BHjb2xbt+KSix+8XLGxxPvQ=="}} {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:16:07.954748 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.quota [None req-984c423c-6348-4c3c-8990-ed2dbc5f9fe9 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Getting quotas for project 36f63b28bb4f4654b53a01507b337d52. Resources: {'key_pairs'} {{(pid=118887) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 03:16:07.959122 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.quota [None req-984c423c-6348-4c3c-8990-ed2dbc5f9fe9 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Getting quotas for user 37e6d36d529146299970874660e92e43 and project 36f63b28bb4f4654b53a01507b337d52. Resources: {'key_pairs'} {{(pid=118887) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 03:16:07.984080 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-984c423c-6348-4c3c-8990-ed2dbc5f9fe9 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.050888 Oct 17 03:16:07.984678 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 293/618] 10.222.0.27 () {62 vars in 1200 bytes} [Mon Oct 17 03:16:07 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 52 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Oct 17 03:16:08.116221 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [req-cb5bad7c-3743-4d30-80b8-a6492b412103 req-3f83c586-570a-4ad4-a7ff-df353e1581cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d521fa69-4f04-4d79-8a81-22b2e4bafbae", "tag": "3057284f-cd50-4b2a-8fd1-40b4a9779789"}]} {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:16:08.126464 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [req-cb5bad7c-3743-4d30-80b8-a6492b412103 req-3f83c586-570a-4ad4-a7ff-df353e1581cf service nova] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:08.126975 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [req-cb5bad7c-3743-4d30-80b8-a6492b412103 req-3f83c586-570a-4ad4-a7ff-df353e1581cf service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:08.127401 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [req-cb5bad7c-3743-4d30-80b8-a6492b412103 req-3f83c586-570a-4ad4-a7ff-df353e1581cf service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:08.139577 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.compute.server_external_events [req-cb5bad7c-3743-4d30-80b8-a6492b412103 req-3f83c586-570a-4ad4-a7ff-df353e1581cf service nova] Creating event network-changed:3057284f-cd50-4b2a-8fd1-40b4a9779789 for instance d521fa69-4f04-4d79-8a81-22b2e4bafbae on hv-cinder-84697 Oct 17 03:16:08.144556 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [req-cb5bad7c-3743-4d30-80b8-a6492b412103 req-3f83c586-570a-4ad4-a7ff-df353e1581cf service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031922 Oct 17 03:16:08.147193 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 326/619] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 03:16:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:16:08.849466 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-30c76bd6-75b1-432c-a957-154b78af1c71 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:16:08.850201 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-30c76bd6-75b1-432c-a957-154b78af1c71 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: 712578d1-d2fb-4252-adbb-bc87096acc00] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:16:08.858458 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-30c76bd6-75b1-432c-a957-154b78af1c71 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:08.859155 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-30c76bd6-75b1-432c-a957-154b78af1c71 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:08.859760 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-30c76bd6-75b1-432c-a957-154b78af1c71 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:08.860543 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-30c76bd6-75b1-432c-a957-154b78af1c71 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:08.861812 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-30c76bd6-75b1-432c-a957-154b78af1c71 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:08.862322 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-30c76bd6-75b1-432c-a957-154b78af1c71 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:09.004384 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-30c76bd6-75b1-432c-a957-154b78af1c71 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1787a9ef7c44e28076aaa80c0152fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee21a91b84794e80b208fe72b7f1e010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:16:09.014018 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-30c76bd6-75b1-432c-a957-154b78af1c71 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "GET /compute/v2.1/servers/712578d1-d2fb-4252-adbb-bc87096acc00" status: 200 len: 1735 microversion: 2.1 time: 0.168643 Oct 17 03:16:09.014706 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 294/620] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:16:08 2022] GET /compute/v2.1/servers/712578d1-d2fb-4252-adbb-bc87096acc00 => generated 1735 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:16:09.468175 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-dbbcf6e5-3081-4e1d-b2de-4e8b40bf605a tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1417331820", "imageRef": "e6d41914-f1bc-4b72-9113-1a69b3d0d83b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7be2416a-9e29-4953-b802-c76adc0aa669"}], "security_groups": [{"name": "tempest-securitygroup--954974493"}], "key_name": "tempest-keypair-988862253", "user_data": "}} {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:16:09.572639 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.network.neutron [None req-dbbcf6e5-3081-4e1d-b2de-4e8b40bf605a tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] validate_networks() for [('7be2416a-9e29-4953-b802-c76adc0aa669', None, None, None, None, None)] {{(pid=118886) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 03:16:09.941474 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.virt.hardware [None req-dbbcf6e5-3081-4e1d-b2de-4e8b40bf605a tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Flavor limits 0:0:0 {{(pid=118886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 03:16:09.941921 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.virt.hardware [None req-dbbcf6e5-3081-4e1d-b2de-4e8b40bf605a tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Image limits 0:0:0 {{(pid=118886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 03:16:09.942415 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.virt.hardware [None req-dbbcf6e5-3081-4e1d-b2de-4e8b40bf605a tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Flavor pref 0:0:0 {{(pid=118886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 03:16:09.942819 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.virt.hardware [None req-dbbcf6e5-3081-4e1d-b2de-4e8b40bf605a tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Image pref 0:0:0 {{(pid=118886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 03:16:09.943247 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.virt.hardware [None req-dbbcf6e5-3081-4e1d-b2de-4e8b40bf605a tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 03:16:09.952463 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-dbbcf6e5-3081-4e1d-b2de-4e8b40bf605a tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:09.952974 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-dbbcf6e5-3081-4e1d-b2de-4e8b40bf605a tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:09.953402 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-dbbcf6e5-3081-4e1d-b2de-4e8b40bf605a tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:09.954120 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-dbbcf6e5-3081-4e1d-b2de-4e8b40bf605a tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:09.954571 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-dbbcf6e5-3081-4e1d-b2de-4e8b40bf605a tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:09.955018 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-dbbcf6e5-3081-4e1d-b2de-4e8b40bf605a tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:09.972256 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.quota [None req-dbbcf6e5-3081-4e1d-b2de-4e8b40bf605a tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Getting quotas for project 36f63b28bb4f4654b53a01507b337d52. Resources: {'instances', 'cores', 'ram'} {{(pid=118886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 03:16:09.976216 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.quota [None req-dbbcf6e5-3081-4e1d-b2de-4e8b40bf605a tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Getting quotas for user 37e6d36d529146299970874660e92e43 and project 36f63b28bb4f4654b53a01507b337d52. Resources: {'instances', 'cores', 'ram'} {{(pid=118886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 03:16:09.987191 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-dbbcf6e5-3081-4e1d-b2de-4e8b40bf605a tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Going to run 1 instances... {{(pid=118886) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 03:16:09.989595 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-dbbcf6e5-3081-4e1d-b2de-4e8b40bf605a tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 78c535d2-a4ae-43ff-bf93-8c35dfb79876] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e6d41914-f1bc-4b72-9113-1a69b3d0d83b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 03:16:10.037569 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-dbbcf6e5-3081-4e1d-b2de-4e8b40bf605a tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.573918 Oct 17 03:16:10.038297 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 327/621] 10.222.0.27 () {62 vars in 1188 bytes} [Mon Oct 17 03:16:09 2022] POST /compute/v2.1/servers => generated 401 bytes in 576 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 17 03:16:10.039387 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-0a207990-b75a-40bb-b3b2-7e986dab3ba7 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:16:10.040110 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-0a207990-b75a-40bb-b3b2-7e986dab3ba7 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: 712578d1-d2fb-4252-adbb-bc87096acc00] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:16:10.047254 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-0a207990-b75a-40bb-b3b2-7e986dab3ba7 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:10.048049 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-0a207990-b75a-40bb-b3b2-7e986dab3ba7 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:10.048703 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-0a207990-b75a-40bb-b3b2-7e986dab3ba7 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:10.049299 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-7ae601e7-0e0b-4073-a19e-db7e1efe7e70 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:16:10.049575 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-0a207990-b75a-40bb-b3b2-7e986dab3ba7 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:10.049905 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-7ae601e7-0e0b-4073-a19e-db7e1efe7e70 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 78c535d2-a4ae-43ff-bf93-8c35dfb79876] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:16:10.050034 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-0a207990-b75a-40bb-b3b2-7e986dab3ba7 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:10.050452 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-0a207990-b75a-40bb-b3b2-7e986dab3ba7 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:10.106716 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-7ae601e7-0e0b-4073-a19e-db7e1efe7e70 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:16:10.115918 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-7ae601e7-0e0b-4073-a19e-db7e1efe7e70 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:16:10.117366 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-7ae601e7-0e0b-4073-a19e-db7e1efe7e70 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:16:10.120188 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-7ae601e7-0e0b-4073-a19e-db7e1efe7e70 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "GET /compute/v2.1/servers/78c535d2-a4ae-43ff-bf93-8c35dfb79876" status: 200 len: 1281 microversion: 2.20 time: 0.073617 Oct 17 03:16:10.121081 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 328/622] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 03:16:10 2022] GET /compute/v2.1/servers/78c535d2-a4ae-43ff-bf93-8c35dfb79876 => generated 1281 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:16:10.204971 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-0a207990-b75a-40bb-b3b2-7e986dab3ba7 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1787a9ef7c44e28076aaa80c0152fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee21a91b84794e80b208fe72b7f1e010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:16:10.213316 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-0a207990-b75a-40bb-b3b2-7e986dab3ba7 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "GET /compute/v2.1/servers/712578d1-d2fb-4252-adbb-bc87096acc00" status: 200 len: 1735 microversion: 2.1 time: 0.178224 Oct 17 03:16:10.213874 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 295/623] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:16:10 2022] GET /compute/v2.1/servers/712578d1-d2fb-4252-adbb-bc87096acc00 => generated 1735 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:16:11.145768 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-e0a7c999-3560-480c-b156-8ec346334f7d tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:16:11.146397 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-e0a7c999-3560-480c-b156-8ec346334f7d tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 78c535d2-a4ae-43ff-bf93-8c35dfb79876] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:16:11.154892 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-e0a7c999-3560-480c-b156-8ec346334f7d tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:11.155385 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-e0a7c999-3560-480c-b156-8ec346334f7d tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:11.155817 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-e0a7c999-3560-480c-b156-8ec346334f7d tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:11.156505 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-e0a7c999-3560-480c-b156-8ec346334f7d tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:11.156954 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-e0a7c999-3560-480c-b156-8ec346334f7d tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:11.157631 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-e0a7c999-3560-480c-b156-8ec346334f7d tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:11.225906 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-e0a7c999-3560-480c-b156-8ec346334f7d tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:16:11.236640 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-e0a7c999-3560-480c-b156-8ec346334f7d tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:16:11.238090 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-e0a7c999-3560-480c-b156-8ec346334f7d tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:16:11.239225 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-e0a7c999-3560-480c-b156-8ec346334f7d tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "GET /compute/v2.1/servers/78c535d2-a4ae-43ff-bf93-8c35dfb79876" status: 200 len: 1341 microversion: 2.20 time: 0.097366 Oct 17 03:16:11.240073 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 329/624] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 03:16:11 2022] GET /compute/v2.1/servers/78c535d2-a4ae-43ff-bf93-8c35dfb79876 => generated 1341 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 03:16:11.243361 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-00375518-0888-437e-bfd9-f970627b64fc tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:16:11.248947 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-00375518-0888-437e-bfd9-f970627b64fc tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: 712578d1-d2fb-4252-adbb-bc87096acc00] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:16:11.261407 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-00375518-0888-437e-bfd9-f970627b64fc tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:11.262133 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-00375518-0888-437e-bfd9-f970627b64fc tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:11.262782 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-00375518-0888-437e-bfd9-f970627b64fc tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:11.263727 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-00375518-0888-437e-bfd9-f970627b64fc tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:11.264377 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-00375518-0888-437e-bfd9-f970627b64fc tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:11.265000 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-00375518-0888-437e-bfd9-f970627b64fc tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:11.431137 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-00375518-0888-437e-bfd9-f970627b64fc tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1787a9ef7c44e28076aaa80c0152fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee21a91b84794e80b208fe72b7f1e010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:16:11.439333 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-00375518-0888-437e-bfd9-f970627b64fc tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "GET /compute/v2.1/servers/712578d1-d2fb-4252-adbb-bc87096acc00" status: 200 len: 1735 microversion: 2.1 time: 0.206628 Oct 17 03:16:11.439898 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 296/625] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:16:11 2022] GET /compute/v2.1/servers/712578d1-d2fb-4252-adbb-bc87096acc00 => generated 1735 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:16:12.264387 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-5c22a158-4ed9-41e0-b7cd-74991de0c177 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:16:12.265099 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-5c22a158-4ed9-41e0-b7cd-74991de0c177 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 78c535d2-a4ae-43ff-bf93-8c35dfb79876] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:16:12.271436 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-5c22a158-4ed9-41e0-b7cd-74991de0c177 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:12.271913 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-5c22a158-4ed9-41e0-b7cd-74991de0c177 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:12.272345 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-5c22a158-4ed9-41e0-b7cd-74991de0c177 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:12.273037 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-5c22a158-4ed9-41e0-b7cd-74991de0c177 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:12.273479 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-5c22a158-4ed9-41e0-b7cd-74991de0c177 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:12.273906 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-5c22a158-4ed9-41e0-b7cd-74991de0c177 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:12.410423 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-5c22a158-4ed9-41e0-b7cd-74991de0c177 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:16:12.420500 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-5c22a158-4ed9-41e0-b7cd-74991de0c177 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:16:12.422017 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-5c22a158-4ed9-41e0-b7cd-74991de0c177 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:16:12.423193 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-5c22a158-4ed9-41e0-b7cd-74991de0c177 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "GET /compute/v2.1/servers/78c535d2-a4ae-43ff-bf93-8c35dfb79876" status: 200 len: 1406 microversion: 2.20 time: 0.162872 Oct 17 03:16:12.423747 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 330/626] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 03:16:12 2022] GET /compute/v2.1/servers/78c535d2-a4ae-43ff-bf93-8c35dfb79876 => generated 1406 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:16:12.462209 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-8f5c4ac9-f40a-4860-b84e-4dba732b2751 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:16:12.463043 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-8f5c4ac9-f40a-4860-b84e-4dba732b2751 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: 712578d1-d2fb-4252-adbb-bc87096acc00] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:16:12.469166 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-8f5c4ac9-f40a-4860-b84e-4dba732b2751 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:12.469647 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-8f5c4ac9-f40a-4860-b84e-4dba732b2751 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:12.470072 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-8f5c4ac9-f40a-4860-b84e-4dba732b2751 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:12.470761 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-8f5c4ac9-f40a-4860-b84e-4dba732b2751 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:12.471237 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-8f5c4ac9-f40a-4860-b84e-4dba732b2751 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:12.471658 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-8f5c4ac9-f40a-4860-b84e-4dba732b2751 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:12.654820 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-8f5c4ac9-f40a-4860-b84e-4dba732b2751 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1787a9ef7c44e28076aaa80c0152fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee21a91b84794e80b208fe72b7f1e010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:16:12.663373 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-8f5c4ac9-f40a-4860-b84e-4dba732b2751 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "GET /compute/v2.1/servers/712578d1-d2fb-4252-adbb-bc87096acc00" status: 200 len: 1735 microversion: 2.1 time: 0.205596 Oct 17 03:16:12.663943 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 297/627] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:16:12 2022] GET /compute/v2.1/servers/712578d1-d2fb-4252-adbb-bc87096acc00 => generated 1735 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:16:12.734894 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [req-3b9d0a74-ba66-4441-a9b7-054128949021 req-a735621e-1a8f-4807-bda7-7881fec374ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78c535d2-a4ae-43ff-bf93-8c35dfb79876", "tag": "0fcb1d19-78cc-466d-b47b-f0891a46de92"}]} {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:16:12.747244 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [req-3b9d0a74-ba66-4441-a9b7-054128949021 req-a735621e-1a8f-4807-bda7-7881fec374ec service nova] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:12.747723 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [req-3b9d0a74-ba66-4441-a9b7-054128949021 req-a735621e-1a8f-4807-bda7-7881fec374ec service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:12.748150 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [req-3b9d0a74-ba66-4441-a9b7-054128949021 req-a735621e-1a8f-4807-bda7-7881fec374ec service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:12.760501 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.compute.server_external_events [req-3b9d0a74-ba66-4441-a9b7-054128949021 req-a735621e-1a8f-4807-bda7-7881fec374ec service nova] Creating event network-changed:0fcb1d19-78cc-466d-b47b-f0891a46de92 for instance 78c535d2-a4ae-43ff-bf93-8c35dfb79876 on hv-cinder-84697 Oct 17 03:16:12.765221 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [req-3b9d0a74-ba66-4441-a9b7-054128949021 req-a735621e-1a8f-4807-bda7-7881fec374ec service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034418 Oct 17 03:16:12.766009 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 331/628] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 03:16:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 03:16:13.448051 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-6f873087-560a-4c90-964f-5ded160a7fff tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:16:13.448598 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-6f873087-560a-4c90-964f-5ded160a7fff tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 78c535d2-a4ae-43ff-bf93-8c35dfb79876] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:16:13.454613 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-6f873087-560a-4c90-964f-5ded160a7fff tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:13.455116 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-6f873087-560a-4c90-964f-5ded160a7fff tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:13.455542 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-6f873087-560a-4c90-964f-5ded160a7fff tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:13.456216 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-6f873087-560a-4c90-964f-5ded160a7fff tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:13.456660 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-6f873087-560a-4c90-964f-5ded160a7fff tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:13.457076 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-6f873087-560a-4c90-964f-5ded160a7fff tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:13.585040 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-6f873087-560a-4c90-964f-5ded160a7fff tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:16:13.593790 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-6f873087-560a-4c90-964f-5ded160a7fff tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:16:13.595244 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-6f873087-560a-4c90-964f-5ded160a7fff tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:16:13.596321 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-6f873087-560a-4c90-964f-5ded160a7fff tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "GET /compute/v2.1/servers/78c535d2-a4ae-43ff-bf93-8c35dfb79876" status: 200 len: 1406 microversion: 2.20 time: 0.152240 Oct 17 03:16:13.596869 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 298/629] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 03:16:13 2022] GET /compute/v2.1/servers/78c535d2-a4ae-43ff-bf93-8c35dfb79876 => generated 1406 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 03:16:13.687293 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-cede891b-1657-4ec3-a17a-88d9b4b8c04d tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:16:13.687985 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-cede891b-1657-4ec3-a17a-88d9b4b8c04d tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: 712578d1-d2fb-4252-adbb-bc87096acc00] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:16:13.694689 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-cede891b-1657-4ec3-a17a-88d9b4b8c04d tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:13.695207 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-cede891b-1657-4ec3-a17a-88d9b4b8c04d tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:13.695644 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-cede891b-1657-4ec3-a17a-88d9b4b8c04d tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:13.696845 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-cede891b-1657-4ec3-a17a-88d9b4b8c04d tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:13.697382 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-cede891b-1657-4ec3-a17a-88d9b4b8c04d tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:13.697810 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-cede891b-1657-4ec3-a17a-88d9b4b8c04d tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:13.828182 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-cede891b-1657-4ec3-a17a-88d9b4b8c04d tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1787a9ef7c44e28076aaa80c0152fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee21a91b84794e80b208fe72b7f1e010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:16:13.836227 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-cede891b-1657-4ec3-a17a-88d9b4b8c04d tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "GET /compute/v2.1/servers/712578d1-d2fb-4252-adbb-bc87096acc00" status: 200 len: 1735 microversion: 2.1 time: 0.153143 Oct 17 03:16:13.837585 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 332/630] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:16:13 2022] GET /compute/v2.1/servers/712578d1-d2fb-4252-adbb-bc87096acc00 => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:16:14.621768 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-21dd1514-975c-40f3-8ee1-15d3aa958571 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:16:14.622363 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-21dd1514-975c-40f3-8ee1-15d3aa958571 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 78c535d2-a4ae-43ff-bf93-8c35dfb79876] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:16:14.629065 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-21dd1514-975c-40f3-8ee1-15d3aa958571 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:14.629546 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-21dd1514-975c-40f3-8ee1-15d3aa958571 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:14.630003 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-21dd1514-975c-40f3-8ee1-15d3aa958571 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:14.630693 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-21dd1514-975c-40f3-8ee1-15d3aa958571 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:14.631178 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-21dd1514-975c-40f3-8ee1-15d3aa958571 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:14.631603 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-21dd1514-975c-40f3-8ee1-15d3aa958571 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:14.649707 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG dbcounter [-] [118887] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:16:14.765613 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-21dd1514-975c-40f3-8ee1-15d3aa958571 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:16:14.773942 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-21dd1514-975c-40f3-8ee1-15d3aa958571 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:16:14.776032 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-21dd1514-975c-40f3-8ee1-15d3aa958571 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:16:14.777052 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-21dd1514-975c-40f3-8ee1-15d3aa958571 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "GET /compute/v2.1/servers/78c535d2-a4ae-43ff-bf93-8c35dfb79876" status: 200 len: 1406 microversion: 2.20 time: 0.159876 Oct 17 03:16:14.777606 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 299/631] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 03:16:14 2022] GET /compute/v2.1/servers/78c535d2-a4ae-43ff-bf93-8c35dfb79876 => generated 1406 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:16:14.859696 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-4e634a48-e5e2-48be-a959-19d014584090 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:16:14.860299 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-4e634a48-e5e2-48be-a959-19d014584090 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: 712578d1-d2fb-4252-adbb-bc87096acc00] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:16:14.866667 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-4e634a48-e5e2-48be-a959-19d014584090 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:14.867179 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-4e634a48-e5e2-48be-a959-19d014584090 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:14.867615 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-4e634a48-e5e2-48be-a959-19d014584090 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:14.868422 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-4e634a48-e5e2-48be-a959-19d014584090 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:14.868876 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-4e634a48-e5e2-48be-a959-19d014584090 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:14.869297 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-4e634a48-e5e2-48be-a959-19d014584090 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:14.995459 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-4e634a48-e5e2-48be-a959-19d014584090 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1787a9ef7c44e28076aaa80c0152fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee21a91b84794e80b208fe72b7f1e010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:16:15.003651 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-4e634a48-e5e2-48be-a959-19d014584090 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "GET /compute/v2.1/servers/712578d1-d2fb-4252-adbb-bc87096acc00" status: 200 len: 1735 microversion: 2.1 time: 0.147839 Oct 17 03:16:15.004209 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 333/632] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:16:14 2022] GET /compute/v2.1/servers/712578d1-d2fb-4252-adbb-bc87096acc00 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:16:15.802054 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-bbcea37b-3fd4-414d-8d9a-e190c2320c41 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:16:15.802702 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-bbcea37b-3fd4-414d-8d9a-e190c2320c41 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 78c535d2-a4ae-43ff-bf93-8c35dfb79876] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:16:15.809980 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-bbcea37b-3fd4-414d-8d9a-e190c2320c41 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:15.810458 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-bbcea37b-3fd4-414d-8d9a-e190c2320c41 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:15.810976 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-bbcea37b-3fd4-414d-8d9a-e190c2320c41 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:15.811673 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-bbcea37b-3fd4-414d-8d9a-e190c2320c41 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:15.812137 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-bbcea37b-3fd4-414d-8d9a-e190c2320c41 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:15.812575 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-bbcea37b-3fd4-414d-8d9a-e190c2320c41 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:15.937608 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-bbcea37b-3fd4-414d-8d9a-e190c2320c41 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:16:15.945630 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-bbcea37b-3fd4-414d-8d9a-e190c2320c41 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:16:15.947298 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-bbcea37b-3fd4-414d-8d9a-e190c2320c41 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:16:15.948439 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-bbcea37b-3fd4-414d-8d9a-e190c2320c41 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "GET /compute/v2.1/servers/78c535d2-a4ae-43ff-bf93-8c35dfb79876" status: 200 len: 1406 microversion: 2.20 time: 0.150208 Oct 17 03:16:15.948942 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 300/633] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 03:16:15 2022] GET /compute/v2.1/servers/78c535d2-a4ae-43ff-bf93-8c35dfb79876 => generated 1406 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:16:16.026755 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-76a07f7d-d5e2-4099-acc3-50d2e710d40f tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:16:16.027455 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-76a07f7d-d5e2-4099-acc3-50d2e710d40f tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: 712578d1-d2fb-4252-adbb-bc87096acc00] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:16:16.034107 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-76a07f7d-d5e2-4099-acc3-50d2e710d40f tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:16.034591 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-76a07f7d-d5e2-4099-acc3-50d2e710d40f tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:16.035062 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-76a07f7d-d5e2-4099-acc3-50d2e710d40f tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:16.035753 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-76a07f7d-d5e2-4099-acc3-50d2e710d40f tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:16.036205 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-76a07f7d-d5e2-4099-acc3-50d2e710d40f tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:16.036653 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-76a07f7d-d5e2-4099-acc3-50d2e710d40f tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:16.164351 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-76a07f7d-d5e2-4099-acc3-50d2e710d40f tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1787a9ef7c44e28076aaa80c0152fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee21a91b84794e80b208fe72b7f1e010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:16:16.173087 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-76a07f7d-d5e2-4099-acc3-50d2e710d40f tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "GET /compute/v2.1/servers/712578d1-d2fb-4252-adbb-bc87096acc00" status: 200 len: 1735 microversion: 2.1 time: 0.150238 Oct 17 03:16:16.173659 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 334/634] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:16:16 2022] GET /compute/v2.1/servers/712578d1-d2fb-4252-adbb-bc87096acc00 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:16:16.471172 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [req-08d4d2f2-181c-4d6b-a487-fb2e44e47ec6 req-ab132a19-a5c4-47ca-bc14-75269787e938 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78c535d2-a4ae-43ff-bf93-8c35dfb79876", "name": "network-vif-plugged", "status": "completed", "tag": "0fcb1d19-78cc-466d-b47b-f0891a46de92"}]} {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:16:16.481520 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [req-08d4d2f2-181c-4d6b-a487-fb2e44e47ec6 req-ab132a19-a5c4-47ca-bc14-75269787e938 service nova] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:16.482007 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [req-08d4d2f2-181c-4d6b-a487-fb2e44e47ec6 req-ab132a19-a5c4-47ca-bc14-75269787e938 service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:16.482407 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [req-08d4d2f2-181c-4d6b-a487-fb2e44e47ec6 req-ab132a19-a5c4-47ca-bc14-75269787e938 service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:16.493718 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.compute.server_external_events [req-08d4d2f2-181c-4d6b-a487-fb2e44e47ec6 req-ab132a19-a5c4-47ca-bc14-75269787e938 service nova] Creating event network-vif-plugged:0fcb1d19-78cc-466d-b47b-f0891a46de92 for instance 78c535d2-a4ae-43ff-bf93-8c35dfb79876 on hv-cinder-84697 Oct 17 03:16:16.498614 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [req-08d4d2f2-181c-4d6b-a487-fb2e44e47ec6 req-ab132a19-a5c4-47ca-bc14-75269787e938 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031140 Oct 17 03:16:16.499307 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 301/635] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 03:16:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:16:16.973664 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-a863145c-1f78-45ed-853a-57481906f118 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:16:16.974293 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-a863145c-1f78-45ed-853a-57481906f118 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 78c535d2-a4ae-43ff-bf93-8c35dfb79876] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:16:16.981433 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-a863145c-1f78-45ed-853a-57481906f118 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:16.981913 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-a863145c-1f78-45ed-853a-57481906f118 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:16.982347 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-a863145c-1f78-45ed-853a-57481906f118 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:16.983066 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-a863145c-1f78-45ed-853a-57481906f118 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:16.983519 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-a863145c-1f78-45ed-853a-57481906f118 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:16.983938 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-a863145c-1f78-45ed-853a-57481906f118 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:16.987994 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG dbcounter [-] [118886] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:16:17.114520 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-a863145c-1f78-45ed-853a-57481906f118 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:16:17.122749 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-a863145c-1f78-45ed-853a-57481906f118 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:16:17.124235 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-a863145c-1f78-45ed-853a-57481906f118 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:16:17.125332 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-a863145c-1f78-45ed-853a-57481906f118 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "GET /compute/v2.1/servers/78c535d2-a4ae-43ff-bf93-8c35dfb79876" status: 200 len: 1406 microversion: 2.20 time: 0.156342 Oct 17 03:16:17.125882 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 335/636] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 03:16:16 2022] GET /compute/v2.1/servers/78c535d2-a4ae-43ff-bf93-8c35dfb79876 => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:16:17.197028 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-a9d2548f-cc79-4699-be9c-f069f949f89d tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:16:17.197743 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-a9d2548f-cc79-4699-be9c-f069f949f89d tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: 712578d1-d2fb-4252-adbb-bc87096acc00] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:16:17.203836 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-a9d2548f-cc79-4699-be9c-f069f949f89d tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:17.204310 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-a9d2548f-cc79-4699-be9c-f069f949f89d tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:17.204738 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-a9d2548f-cc79-4699-be9c-f069f949f89d tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:17.205413 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-a9d2548f-cc79-4699-be9c-f069f949f89d tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:17.205855 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-a9d2548f-cc79-4699-be9c-f069f949f89d tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:17.206275 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-a9d2548f-cc79-4699-be9c-f069f949f89d tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:17.336745 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-a9d2548f-cc79-4699-be9c-f069f949f89d tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1787a9ef7c44e28076aaa80c0152fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee21a91b84794e80b208fe72b7f1e010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:16:17.346283 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-a9d2548f-cc79-4699-be9c-f069f949f89d tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "GET /compute/v2.1/servers/712578d1-d2fb-4252-adbb-bc87096acc00" status: 200 len: 1735 microversion: 2.1 time: 0.153972 Oct 17 03:16:17.346845 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 302/637] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:16:17 2022] GET /compute/v2.1/servers/712578d1-d2fb-4252-adbb-bc87096acc00 => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:16:18.149591 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-2054e740-88e1-40e3-9765-e46968bf3b00 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:16:18.150307 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-2054e740-88e1-40e3-9765-e46968bf3b00 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 78c535d2-a4ae-43ff-bf93-8c35dfb79876] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:16:18.156585 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-2054e740-88e1-40e3-9765-e46968bf3b00 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:18.157056 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-2054e740-88e1-40e3-9765-e46968bf3b00 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:18.157748 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-2054e740-88e1-40e3-9765-e46968bf3b00 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:18.158424 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-2054e740-88e1-40e3-9765-e46968bf3b00 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:18.158889 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-2054e740-88e1-40e3-9765-e46968bf3b00 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:18.159304 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-2054e740-88e1-40e3-9765-e46968bf3b00 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:18.290749 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-2054e740-88e1-40e3-9765-e46968bf3b00 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:16:18.299876 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-2054e740-88e1-40e3-9765-e46968bf3b00 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:16:18.301310 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-2054e740-88e1-40e3-9765-e46968bf3b00 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:16:18.302403 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-2054e740-88e1-40e3-9765-e46968bf3b00 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "GET /compute/v2.1/servers/78c535d2-a4ae-43ff-bf93-8c35dfb79876" status: 200 len: 1406 microversion: 2.20 time: 0.156813 Oct 17 03:16:18.303021 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 336/638] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 03:16:18 2022] GET /compute/v2.1/servers/78c535d2-a4ae-43ff-bf93-8c35dfb79876 => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:16:18.370024 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-8b70eea8-bb9b-4d32-9781-00dd77436f4b tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:16:18.370740 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-8b70eea8-bb9b-4d32-9781-00dd77436f4b tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: 712578d1-d2fb-4252-adbb-bc87096acc00] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:16:18.372781 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG dbcounter [-] [118887] Writing DB stats nova_cell0:SELECT=4 {{(pid=118887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:16:18.379017 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-8b70eea8-bb9b-4d32-9781-00dd77436f4b tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:18.379503 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-8b70eea8-bb9b-4d32-9781-00dd77436f4b tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:18.379937 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-8b70eea8-bb9b-4d32-9781-00dd77436f4b tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:18.380637 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-8b70eea8-bb9b-4d32-9781-00dd77436f4b tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:18.381165 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-8b70eea8-bb9b-4d32-9781-00dd77436f4b tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:18.381783 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-8b70eea8-bb9b-4d32-9781-00dd77436f4b tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:18.510284 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-8b70eea8-bb9b-4d32-9781-00dd77436f4b tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1787a9ef7c44e28076aaa80c0152fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee21a91b84794e80b208fe72b7f1e010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:16:18.518490 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-8b70eea8-bb9b-4d32-9781-00dd77436f4b tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "GET /compute/v2.1/servers/712578d1-d2fb-4252-adbb-bc87096acc00" status: 200 len: 1735 microversion: 2.1 time: 0.153068 Oct 17 03:16:18.519257 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 303/639] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:16:18 2022] GET /compute/v2.1/servers/712578d1-d2fb-4252-adbb-bc87096acc00 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:16:19.328606 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-c50f4bae-f38f-4c9d-8273-7751f5edb4c6 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:16:19.329200 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-c50f4bae-f38f-4c9d-8273-7751f5edb4c6 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 78c535d2-a4ae-43ff-bf93-8c35dfb79876] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:16:19.335304 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-c50f4bae-f38f-4c9d-8273-7751f5edb4c6 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:19.335775 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-c50f4bae-f38f-4c9d-8273-7751f5edb4c6 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:19.336200 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-c50f4bae-f38f-4c9d-8273-7751f5edb4c6 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:19.336871 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-c50f4bae-f38f-4c9d-8273-7751f5edb4c6 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:19.337314 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-c50f4bae-f38f-4c9d-8273-7751f5edb4c6 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:19.337725 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-c50f4bae-f38f-4c9d-8273-7751f5edb4c6 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:19.464087 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-c50f4bae-f38f-4c9d-8273-7751f5edb4c6 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:16:19.471998 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-c50f4bae-f38f-4c9d-8273-7751f5edb4c6 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:16:19.473432 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-c50f4bae-f38f-4c9d-8273-7751f5edb4c6 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:16:19.474557 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-c50f4bae-f38f-4c9d-8273-7751f5edb4c6 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "GET /compute/v2.1/servers/78c535d2-a4ae-43ff-bf93-8c35dfb79876" status: 200 len: 1598 microversion: 2.20 time: 0.149889 Oct 17 03:16:19.475181 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 337/640] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 03:16:19 2022] GET /compute/v2.1/servers/78c535d2-a4ae-43ff-bf93-8c35dfb79876 => generated 1598 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:16:19.499104 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-08706ab0-d8d9-4039-bbef-b71cab6d5024 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:16:19.499586 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-08706ab0-d8d9-4039-bbef-b71cab6d5024 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 78c535d2-a4ae-43ff-bf93-8c35dfb79876] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:16:19.506017 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-08706ab0-d8d9-4039-bbef-b71cab6d5024 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:19.506494 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-08706ab0-d8d9-4039-bbef-b71cab6d5024 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:19.506946 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-08706ab0-d8d9-4039-bbef-b71cab6d5024 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:19.507857 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-08706ab0-d8d9-4039-bbef-b71cab6d5024 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:19.508307 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-08706ab0-d8d9-4039-bbef-b71cab6d5024 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:19.509314 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-08706ab0-d8d9-4039-bbef-b71cab6d5024 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:19.542684 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-30a9d89a-08ba-4a9a-8e8c-30a63816ec72 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:16:19.543326 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-30a9d89a-08ba-4a9a-8e8c-30a63816ec72 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: 712578d1-d2fb-4252-adbb-bc87096acc00] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:16:19.549323 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-30a9d89a-08ba-4a9a-8e8c-30a63816ec72 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:19.549800 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-30a9d89a-08ba-4a9a-8e8c-30a63816ec72 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:19.550228 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-30a9d89a-08ba-4a9a-8e8c-30a63816ec72 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:19.550942 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-30a9d89a-08ba-4a9a-8e8c-30a63816ec72 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:19.551442 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-30a9d89a-08ba-4a9a-8e8c-30a63816ec72 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:19.551861 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-30a9d89a-08ba-4a9a-8e8c-30a63816ec72 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:19.587878 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-08706ab0-d8d9-4039-bbef-b71cab6d5024 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "GET /compute/v2.1/servers/78c535d2-a4ae-43ff-bf93-8c35dfb79876/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.092588 Oct 17 03:16:19.588469 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 304/641] 10.222.0.27 () {60 vars in 1316 bytes} [Mon Oct 17 03:16:19 2022] GET /compute/v2.1/servers/78c535d2-a4ae-43ff-bf93-8c35dfb79876/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 03:16:19.686000 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-30a9d89a-08ba-4a9a-8e8c-30a63816ec72 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1787a9ef7c44e28076aaa80c0152fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee21a91b84794e80b208fe72b7f1e010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:16:19.694457 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-30a9d89a-08ba-4a9a-8e8c-30a63816ec72 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "GET /compute/v2.1/servers/712578d1-d2fb-4252-adbb-bc87096acc00" status: 200 len: 1735 microversion: 2.1 time: 0.156026 Oct 17 03:16:19.695222 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 338/642] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:16:19 2022] GET /compute/v2.1/servers/712578d1-d2fb-4252-adbb-bc87096acc00 => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:16:20.495196 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [req-9ce42e18-a4cb-40e1-b63e-2ec43078b9d3 req-41a89437-722c-4560-b28e-e029403b4c3b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78c535d2-a4ae-43ff-bf93-8c35dfb79876", "tag": "0fcb1d19-78cc-466d-b47b-f0891a46de92"}]} {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:16:20.504892 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [req-9ce42e18-a4cb-40e1-b63e-2ec43078b9d3 req-41a89437-722c-4560-b28e-e029403b4c3b service nova] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:20.505480 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [req-9ce42e18-a4cb-40e1-b63e-2ec43078b9d3 req-41a89437-722c-4560-b28e-e029403b4c3b service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:20.505784 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [req-9ce42e18-a4cb-40e1-b63e-2ec43078b9d3 req-41a89437-722c-4560-b28e-e029403b4c3b service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:20.517800 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.compute.server_external_events [req-9ce42e18-a4cb-40e1-b63e-2ec43078b9d3 req-41a89437-722c-4560-b28e-e029403b4c3b service nova] Creating event network-changed:0fcb1d19-78cc-466d-b47b-f0891a46de92 for instance 78c535d2-a4ae-43ff-bf93-8c35dfb79876 on hv-cinder-84697 Oct 17 03:16:20.523447 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [req-9ce42e18-a4cb-40e1-b63e-2ec43078b9d3 req-41a89437-722c-4560-b28e-e029403b4c3b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032164 Oct 17 03:16:20.524037 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 305/643] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 03:16:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:16:20.717798 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-2e05c1f8-8144-45fd-8f54-aaa6152b414c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:16:20.718457 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-2e05c1f8-8144-45fd-8f54-aaa6152b414c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: 712578d1-d2fb-4252-adbb-bc87096acc00] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:16:20.720332 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG dbcounter [-] [118886] Writing DB stats nova_cell0:SELECT=2 {{(pid=118886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:16:20.721168 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG dbcounter [-] [118886] Writing DB stats nova_cell0:SELECT=8 {{(pid=118886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:16:20.728400 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-2e05c1f8-8144-45fd-8f54-aaa6152b414c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:20.728889 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-2e05c1f8-8144-45fd-8f54-aaa6152b414c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:20.729319 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-2e05c1f8-8144-45fd-8f54-aaa6152b414c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:20.730023 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-2e05c1f8-8144-45fd-8f54-aaa6152b414c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:20.730473 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-2e05c1f8-8144-45fd-8f54-aaa6152b414c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:20.730908 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-2e05c1f8-8144-45fd-8f54-aaa6152b414c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:20.874277 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-2e05c1f8-8144-45fd-8f54-aaa6152b414c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1787a9ef7c44e28076aaa80c0152fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee21a91b84794e80b208fe72b7f1e010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:16:20.884523 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-2e05c1f8-8144-45fd-8f54-aaa6152b414c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "GET /compute/v2.1/servers/712578d1-d2fb-4252-adbb-bc87096acc00" status: 200 len: 1735 microversion: 2.1 time: 0.170577 Oct 17 03:16:20.885970 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 339/644] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:16:20 2022] GET /compute/v2.1/servers/712578d1-d2fb-4252-adbb-bc87096acc00 => generated 1735 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:16:21.909511 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-14ee13e2-e28a-4499-a444-1e1fe7a9720e tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:16:21.910203 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-14ee13e2-e28a-4499-a444-1e1fe7a9720e tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: 712578d1-d2fb-4252-adbb-bc87096acc00] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:16:21.916420 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-14ee13e2-e28a-4499-a444-1e1fe7a9720e tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:21.916842 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-14ee13e2-e28a-4499-a444-1e1fe7a9720e tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:21.917276 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-14ee13e2-e28a-4499-a444-1e1fe7a9720e tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:21.917991 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-14ee13e2-e28a-4499-a444-1e1fe7a9720e tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:21.918443 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-14ee13e2-e28a-4499-a444-1e1fe7a9720e tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:21.918889 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-14ee13e2-e28a-4499-a444-1e1fe7a9720e tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:22.050910 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-14ee13e2-e28a-4499-a444-1e1fe7a9720e tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1787a9ef7c44e28076aaa80c0152fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee21a91b84794e80b208fe72b7f1e010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:16:22.058974 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-14ee13e2-e28a-4499-a444-1e1fe7a9720e tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "GET /compute/v2.1/servers/712578d1-d2fb-4252-adbb-bc87096acc00" status: 200 len: 1735 microversion: 2.1 time: 0.154420 Oct 17 03:16:22.059542 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 306/645] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:16:21 2022] GET /compute/v2.1/servers/712578d1-d2fb-4252-adbb-bc87096acc00 => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:16:23.083953 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-b206e25f-9519-4fa7-97ac-e5e1db44f1f3 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:16:23.084827 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-b206e25f-9519-4fa7-97ac-e5e1db44f1f3 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: 712578d1-d2fb-4252-adbb-bc87096acc00] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:16:23.091793 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-b206e25f-9519-4fa7-97ac-e5e1db44f1f3 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:23.092269 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-b206e25f-9519-4fa7-97ac-e5e1db44f1f3 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:23.092697 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-b206e25f-9519-4fa7-97ac-e5e1db44f1f3 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:23.093373 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-b206e25f-9519-4fa7-97ac-e5e1db44f1f3 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:23.093814 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-b206e25f-9519-4fa7-97ac-e5e1db44f1f3 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:23.094229 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-b206e25f-9519-4fa7-97ac-e5e1db44f1f3 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:23.221135 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-b206e25f-9519-4fa7-97ac-e5e1db44f1f3 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1787a9ef7c44e28076aaa80c0152fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee21a91b84794e80b208fe72b7f1e010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:16:23.230124 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-b206e25f-9519-4fa7-97ac-e5e1db44f1f3 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "GET /compute/v2.1/servers/712578d1-d2fb-4252-adbb-bc87096acc00" status: 200 len: 1735 microversion: 2.1 time: 0.149983 Oct 17 03:16:23.230715 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 340/646] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:16:23 2022] GET /compute/v2.1/servers/712578d1-d2fb-4252-adbb-bc87096acc00 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:16:24.254175 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-c418c024-74a9-4668-b620-29fa720df605 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:16:24.254780 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-c418c024-74a9-4668-b620-29fa720df605 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: 712578d1-d2fb-4252-adbb-bc87096acc00] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:16:24.262641 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-c418c024-74a9-4668-b620-29fa720df605 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:24.263313 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-c418c024-74a9-4668-b620-29fa720df605 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:24.264797 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-c418c024-74a9-4668-b620-29fa720df605 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:24.265516 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-c418c024-74a9-4668-b620-29fa720df605 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:24.265974 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-c418c024-74a9-4668-b620-29fa720df605 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:24.266404 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-c418c024-74a9-4668-b620-29fa720df605 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:24.412131 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-c418c024-74a9-4668-b620-29fa720df605 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1787a9ef7c44e28076aaa80c0152fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee21a91b84794e80b208fe72b7f1e010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:16:24.421281 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-c418c024-74a9-4668-b620-29fa720df605 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "GET /compute/v2.1/servers/712578d1-d2fb-4252-adbb-bc87096acc00" status: 200 len: 1735 microversion: 2.1 time: 0.171165 Oct 17 03:16:24.421837 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 307/647] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:16:24 2022] GET /compute/v2.1/servers/712578d1-d2fb-4252-adbb-bc87096acc00 => generated 1735 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:16:25.445275 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-36019aa0-9e6f-4bc9-b4a1-ec040abbad2f tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:16:25.445879 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-36019aa0-9e6f-4bc9-b4a1-ec040abbad2f tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: 712578d1-d2fb-4252-adbb-bc87096acc00] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:16:25.452619 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG dbcounter [-] [118886] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4 {{(pid=118886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:16:25.454339 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-36019aa0-9e6f-4bc9-b4a1-ec040abbad2f tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:25.454906 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-36019aa0-9e6f-4bc9-b4a1-ec040abbad2f tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:25.455374 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-36019aa0-9e6f-4bc9-b4a1-ec040abbad2f tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:25.456074 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-36019aa0-9e6f-4bc9-b4a1-ec040abbad2f tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:25.456524 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-36019aa0-9e6f-4bc9-b4a1-ec040abbad2f tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:25.456944 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-36019aa0-9e6f-4bc9-b4a1-ec040abbad2f tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:25.587911 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-36019aa0-9e6f-4bc9-b4a1-ec040abbad2f tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1787a9ef7c44e28076aaa80c0152fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee21a91b84794e80b208fe72b7f1e010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:16:25.596158 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-36019aa0-9e6f-4bc9-b4a1-ec040abbad2f tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "GET /compute/v2.1/servers/712578d1-d2fb-4252-adbb-bc87096acc00" status: 200 len: 1735 microversion: 2.1 time: 0.154847 Oct 17 03:16:25.596724 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 341/648] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:16:25 2022] GET /compute/v2.1/servers/712578d1-d2fb-4252-adbb-bc87096acc00 => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:16:26.619391 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-67c3b484-8802-44cf-892f-23899669000c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:16:26.620014 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-67c3b484-8802-44cf-892f-23899669000c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: 712578d1-d2fb-4252-adbb-bc87096acc00] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:16:26.622512 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG dbcounter [-] [118887] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=4,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:16:26.628322 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-67c3b484-8802-44cf-892f-23899669000c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:26.628814 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-67c3b484-8802-44cf-892f-23899669000c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:26.629250 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-67c3b484-8802-44cf-892f-23899669000c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:26.629986 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-67c3b484-8802-44cf-892f-23899669000c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:26.630439 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-67c3b484-8802-44cf-892f-23899669000c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:26.630889 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-67c3b484-8802-44cf-892f-23899669000c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:26.758575 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-67c3b484-8802-44cf-892f-23899669000c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1787a9ef7c44e28076aaa80c0152fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee21a91b84794e80b208fe72b7f1e010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:16:26.766760 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-67c3b484-8802-44cf-892f-23899669000c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "GET /compute/v2.1/servers/712578d1-d2fb-4252-adbb-bc87096acc00" status: 200 len: 1735 microversion: 2.1 time: 0.151879 Oct 17 03:16:26.767352 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 308/649] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:16:26 2022] GET /compute/v2.1/servers/712578d1-d2fb-4252-adbb-bc87096acc00 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:16:27.327947 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-ff0b6984-e366-4a12-88dd-80109d9c6e4b tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:16:27.330054 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-ff0b6984-e366-4a12-88dd-80109d9c6e4b tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] [instance: 7b220b35-d9ac-48e4-b898-3d4f6c7be835] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:16:27.336393 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-ff0b6984-e366-4a12-88dd-80109d9c6e4b tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:27.337501 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-ff0b6984-e366-4a12-88dd-80109d9c6e4b tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:27.337929 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-ff0b6984-e366-4a12-88dd-80109d9c6e4b tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:27.338607 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-ff0b6984-e366-4a12-88dd-80109d9c6e4b tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:27.339082 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-ff0b6984-e366-4a12-88dd-80109d9c6e4b tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:27.339499 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-ff0b6984-e366-4a12-88dd-80109d9c6e4b tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:27.367112 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-ff0b6984-e366-4a12-88dd-80109d9c6e4b tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] 10.222.0.27 "GET /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043602 Oct 17 03:16:27.367683 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 342/650] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 17 03:16:27 2022] GET /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 03:16:27.430924 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-8f5d7d60-b9d0-45af-9385-7eea6f2cfb75 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:16:27.431431 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-8f5d7d60-b9d0-45af-9385-7eea6f2cfb75 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] [instance: 7b220b35-d9ac-48e4-b898-3d4f6c7be835] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:16:27.437416 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-8f5d7d60-b9d0-45af-9385-7eea6f2cfb75 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:27.437985 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-8f5d7d60-b9d0-45af-9385-7eea6f2cfb75 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:27.438421 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-8f5d7d60-b9d0-45af-9385-7eea6f2cfb75 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:27.439141 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-8f5d7d60-b9d0-45af-9385-7eea6f2cfb75 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:27.439598 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-8f5d7d60-b9d0-45af-9385-7eea6f2cfb75 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:27.440016 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-8f5d7d60-b9d0-45af-9385-7eea6f2cfb75 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:27.464654 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-8f5d7d60-b9d0-45af-9385-7eea6f2cfb75 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] [instance: 7b220b35-d9ac-48e4-b898-3d4f6c7be835] Going to try to terminate instance {{(pid=118887) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 03:16:27.545716 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-8f5d7d60-b9d0-45af-9385-7eea6f2cfb75 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] 10.222.0.27 "DELETE /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835" status: 204 len: 0 microversion: 2.1 time: 0.117952 Oct 17 03:16:27.546315 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 309/651] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 03:16:27 2022] DELETE /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 03:16:27.554337 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-05648fcc-63b3-47c1-a607-f40db97288c8 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:16:27.555001 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-05648fcc-63b3-47c1-a607-f40db97288c8 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] [instance: 7b220b35-d9ac-48e4-b898-3d4f6c7be835] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:16:27.561436 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-05648fcc-63b3-47c1-a607-f40db97288c8 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:27.561912 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-05648fcc-63b3-47c1-a607-f40db97288c8 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:27.562344 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-05648fcc-63b3-47c1-a607-f40db97288c8 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:27.563058 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-05648fcc-63b3-47c1-a607-f40db97288c8 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:27.563512 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-05648fcc-63b3-47c1-a607-f40db97288c8 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:27.563966 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-05648fcc-63b3-47c1-a607-f40db97288c8 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:27.693124 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-05648fcc-63b3-47c1-a607-f40db97288c8 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce25db99a7b14d0bbaca41fff80e3da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5bad80dc0d74119b2a9cd5c1935e8d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:16:27.703537 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-05648fcc-63b3-47c1-a607-f40db97288c8 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] 10.222.0.27 "GET /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835" status: 200 len: 1675 microversion: 2.1 time: 0.152856 Oct 17 03:16:27.704441 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 343/652] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:16:27 2022] GET /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835 => generated 1675 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:16:27.791626 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-0b142cc1-b121-43cd-b853-3d455569da8f tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:16:27.792320 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-0b142cc1-b121-43cd-b853-3d455569da8f tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: 712578d1-d2fb-4252-adbb-bc87096acc00] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:16:27.798689 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-0b142cc1-b121-43cd-b853-3d455569da8f tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:27.799148 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-0b142cc1-b121-43cd-b853-3d455569da8f tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:27.799599 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-0b142cc1-b121-43cd-b853-3d455569da8f tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:27.800267 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-0b142cc1-b121-43cd-b853-3d455569da8f tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:27.800720 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-0b142cc1-b121-43cd-b853-3d455569da8f tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:27.801141 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-0b142cc1-b121-43cd-b853-3d455569da8f tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:27.927566 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-0b142cc1-b121-43cd-b853-3d455569da8f tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1787a9ef7c44e28076aaa80c0152fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee21a91b84794e80b208fe72b7f1e010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:16:27.936435 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-0b142cc1-b121-43cd-b853-3d455569da8f tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "GET /compute/v2.1/servers/712578d1-d2fb-4252-adbb-bc87096acc00" status: 200 len: 1715 microversion: 2.1 time: 0.149477 Oct 17 03:16:27.937000 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 310/653] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:16:27 2022] GET /compute/v2.1/servers/712578d1-d2fb-4252-adbb-bc87096acc00 => generated 1715 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:16:28.045113 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-bcec73ca-8c3f-4de1-b856-5bb20b591da1 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:16:28.045601 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-bcec73ca-8c3f-4de1-b856-5bb20b591da1 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: 712578d1-d2fb-4252-adbb-bc87096acc00] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:16:28.051524 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-bcec73ca-8c3f-4de1-b856-5bb20b591da1 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:28.051955 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-bcec73ca-8c3f-4de1-b856-5bb20b591da1 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:28.052369 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-bcec73ca-8c3f-4de1-b856-5bb20b591da1 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:28.053069 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-bcec73ca-8c3f-4de1-b856-5bb20b591da1 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:28.053515 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-bcec73ca-8c3f-4de1-b856-5bb20b591da1 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:28.053928 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-bcec73ca-8c3f-4de1-b856-5bb20b591da1 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:28.135502 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.wsgi [None req-bcec73ca-8c3f-4de1-b856-5bb20b591da1 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] HTTP exception thrown: Cannot 'detach_volume' instance 712578d1-d2fb-4252-adbb-bc87096acc00 while it is in vm_state rescued Oct 17 03:16:28.137211 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-bcec73ca-8c3f-4de1-b856-5bb20b591da1 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Request method failure captured: Oct 17 03:16:28.137211 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: request: DELETE /compute/v2.1/servers/712578d1-d2fb-4252-adbb-bc87096acc00/os-volume_attachments/9d69f510-3752-49d0-ab13-0ab7bff311d8 HTTP/1.1 Oct 17 03:16:28.137211 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Accept: application/json Oct 17 03:16:28.137211 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Accept-Encoding: identity Oct 17 03:16:28.137211 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Connection: close Oct 17 03:16:28.137211 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Content-Length: 0 Oct 17 03:16:28.137211 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Content-Type: application/json Oct 17 03:16:28.137211 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Host: 10.222.0.27 Oct 17 03:16:28.137211 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Openstack-System-Scope: None Oct 17 03:16:28.137211 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: User-Agent: python-urllib3/1.26.12 Oct 17 03:16:28.137211 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Auth-Token: gAAAAABjTMf8n_6_Hk42-LQ3323zf7rLyhBkZ7TzI7iXmOD1LZOLQulk-a15ge0ewasywiXZ0G3F3f55kCah96aeBj6-Tg6x0QhgUp1XcnGW8u5zIwcRB_iergkiw_PISrGg1NTyyTzxZ2mz7vHEvQ-8c7ZO9C6TeQ_1FzcAq2bYh8NgMR7sjzA Oct 17 03:16:28.137211 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Domain-Id: None Oct 17 03:16:28.137211 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Domain-Name: None Oct 17 03:16:28.137211 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Identity-Status: Confirmed Oct 17 03:16:28.137211 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Is-Admin-Project: True Oct 17 03:16:28.137211 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Project-Domain-Id: default Oct 17 03:16:28.137211 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Project-Domain-Name: Default Oct 17 03:16:28.137211 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Project-Id: ee21a91b84794e80b208fe72b7f1e010 Oct 17 03:16:28.137211 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1171271233 Oct 17 03:16:28.137211 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Role: member,reader Oct 17 03:16:28.137211 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Roles: member,reader Oct 17 03:16:28.138591 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ee21a91b84794e80b208fe72b7f1e010"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ee21a91b84794e80b208fe72b7f1e010"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ee21a91b84794e80b208fe72b7f1e010"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ee21a91b84794e80b208fe72b7f1e010"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 17 03:16:28.138591 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1171271233 Oct 17 03:16:28.138591 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Tenant-Id: ee21a91b84794e80b208fe72b7f1e010 Oct 17 03:16:28.138591 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1171271233 Oct 17 03:16:28.138591 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-User: tempest-ServerRescueNegativeTestJSON-1171271233-project Oct 17 03:16:28.138591 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-User-Domain-Id: default Oct 17 03:16:28.138591 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-User-Domain-Name: Default Oct 17 03:16:28.138591 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-User-Id: 9c1787a9ef7c44e28076aaa80c0152fd Oct 17 03:16:28.138591 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1171271233-project Oct 17 03:16:28.138591 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: method: > Oct 17 03:16:28.138591 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: exception: Cannot 'detach_volume' instance 712578d1-d2fb-4252-adbb-bc87096acc00 while it is in vm_state rescued Oct 17 03:16:28.139322 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: action_args: {'server_id': '712578d1-d2fb-4252-adbb-bc87096acc00', 'id': '9d69f510-3752-49d0-ab13-0ab7bff311d8'} Oct 17 03:16:28.139322 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 03:16:28.139322 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:16:28.139322 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Oct 17 03:16:28.139322 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Oct 17 03:16:28.139322 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 17 03:16:28.139322 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 17 03:16:28.139322 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 17 03:16:28.139322 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 17 03:16:28.139322 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 712578d1-d2fb-4252-adbb-bc87096acc00 in vm_state rescued. Cannot detach_volume while the instance is in this state. Oct 17 03:16:28.139322 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Oct 17 03:16:28.139322 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:16:28.139322 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Oct 17 03:16:28.139322 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:16:28.139322 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:16:28.139322 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:16:28.139322 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 03:16:28.139322 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 03:16:28.139322 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 03:16:28.139322 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 03:16:28.140912 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Oct 17 03:16:28.140912 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 17 03:16:28.140912 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 17 03:16:28.140912 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 17 03:16:28.140912 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 712578d1-d2fb-4252-adbb-bc87096acc00 while it is in vm_state rescued Oct 17 03:16:28.140912 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Oct 17 03:16:28.140912 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:16:28.140912 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Oct 17 03:16:28.140912 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:16:28.140912 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:16:28.140912 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:16:28.140912 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 03:16:28.140912 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 03:16:28.140912 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 712578d1-d2fb-4252-adbb-bc87096acc00 while it is in vm_state rescued Oct 17 03:16:28.140912 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Oct 17 03:16:28.140912 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-bcec73ca-8c3f-4de1-b856-5bb20b591da1 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Returning 409 to user: Cannot 'detach_volume' instance 712578d1-d2fb-4252-adbb-bc87096acc00 while it is in vm_state rescued {{(pid=118886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 03:16:28.142112 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-bcec73ca-8c3f-4de1-b856-5bb20b591da1 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "DELETE /compute/v2.1/servers/712578d1-d2fb-4252-adbb-bc87096acc00/os-volume_attachments/9d69f510-3752-49d0-ab13-0ab7bff311d8" status: 409 len: 152 microversion: 2.1 time: 0.097464 Oct 17 03:16:28.142112 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 344/654] 10.222.0.27 () {58 vars in 1416 bytes} [Mon Oct 17 03:16:28 2022] DELETE /compute/v2.1/servers/712578d1-d2fb-4252-adbb-bc87096acc00/os-volume_attachments/9d69f510-3752-49d0-ab13-0ab7bff311d8 => generated 152 bytes in 99 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 17 03:16:28.147574 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-f957ab17-8857-44d7-a828-6c07a6ecf029 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:16:28.148105 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-f957ab17-8857-44d7-a828-6c07a6ecf029 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: 712578d1-d2fb-4252-adbb-bc87096acc00] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:16:28.154632 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-f957ab17-8857-44d7-a828-6c07a6ecf029 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:28.155139 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-f957ab17-8857-44d7-a828-6c07a6ecf029 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:28.155573 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-f957ab17-8857-44d7-a828-6c07a6ecf029 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:28.156257 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-f957ab17-8857-44d7-a828-6c07a6ecf029 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:28.156709 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-f957ab17-8857-44d7-a828-6c07a6ecf029 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:28.157126 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-f957ab17-8857-44d7-a828-6c07a6ecf029 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:28.220973 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-f957ab17-8857-44d7-a828-6c07a6ecf029 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "POST /compute/v2.1/servers/712578d1-d2fb-4252-adbb-bc87096acc00/action" status: 202 len: 0 microversion: 2.1 time: 0.077034 Oct 17 03:16:28.224764 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 311/655] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 03:16:28 2022] POST /compute/v2.1/servers/712578d1-d2fb-4252-adbb-bc87096acc00/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 03:16:28.230772 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-709f40c9-fef5-4738-ba5d-e63e0d6631fe tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:16:28.231419 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-709f40c9-fef5-4738-ba5d-e63e0d6631fe tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: 712578d1-d2fb-4252-adbb-bc87096acc00] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:16:28.237332 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-709f40c9-fef5-4738-ba5d-e63e0d6631fe tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:28.237813 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-709f40c9-fef5-4738-ba5d-e63e0d6631fe tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:28.238251 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-709f40c9-fef5-4738-ba5d-e63e0d6631fe tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:28.238967 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-709f40c9-fef5-4738-ba5d-e63e0d6631fe tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:28.239424 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-709f40c9-fef5-4738-ba5d-e63e0d6631fe tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:28.239856 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-709f40c9-fef5-4738-ba5d-e63e0d6631fe tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:28.373689 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-709f40c9-fef5-4738-ba5d-e63e0d6631fe tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1787a9ef7c44e28076aaa80c0152fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee21a91b84794e80b208fe72b7f1e010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:16:28.383154 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-709f40c9-fef5-4738-ba5d-e63e0d6631fe tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "GET /compute/v2.1/servers/712578d1-d2fb-4252-adbb-bc87096acc00" status: 200 len: 1723 microversion: 2.1 time: 0.156807 Oct 17 03:16:28.384164 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 345/656] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:16:28 2022] GET /compute/v2.1/servers/712578d1-d2fb-4252-adbb-bc87096acc00 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:16:28.727938 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-cefa2d78-08d3-4ff2-92d4-f3a7cec9a4dd tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:16:28.728537 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-cefa2d78-08d3-4ff2-92d4-f3a7cec9a4dd tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] [instance: 7b220b35-d9ac-48e4-b898-3d4f6c7be835] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:16:28.734637 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-cefa2d78-08d3-4ff2-92d4-f3a7cec9a4dd tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:28.735142 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-cefa2d78-08d3-4ff2-92d4-f3a7cec9a4dd tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:28.735571 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-cefa2d78-08d3-4ff2-92d4-f3a7cec9a4dd tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:28.736250 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-cefa2d78-08d3-4ff2-92d4-f3a7cec9a4dd tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:28.736696 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-cefa2d78-08d3-4ff2-92d4-f3a7cec9a4dd tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:28.737111 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-cefa2d78-08d3-4ff2-92d4-f3a7cec9a4dd tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:28.867340 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-cefa2d78-08d3-4ff2-92d4-f3a7cec9a4dd tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce25db99a7b14d0bbaca41fff80e3da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5bad80dc0d74119b2a9cd5c1935e8d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:16:28.875489 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-cefa2d78-08d3-4ff2-92d4-f3a7cec9a4dd tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] 10.222.0.27 "GET /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835" status: 200 len: 1675 microversion: 2.1 time: 0.151944 Oct 17 03:16:28.876033 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 312/657] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:16:28 2022] GET /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835 => generated 1675 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:16:29.407407 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-d77aad66-374e-481c-9bd5-d61f53945b3c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:16:29.408272 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-d77aad66-374e-481c-9bd5-d61f53945b3c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: 712578d1-d2fb-4252-adbb-bc87096acc00] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:16:29.415026 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-d77aad66-374e-481c-9bd5-d61f53945b3c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:29.415718 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-d77aad66-374e-481c-9bd5-d61f53945b3c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:29.415962 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-d77aad66-374e-481c-9bd5-d61f53945b3c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:29.416662 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-d77aad66-374e-481c-9bd5-d61f53945b3c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:29.417114 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-d77aad66-374e-481c-9bd5-d61f53945b3c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:29.417538 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-d77aad66-374e-481c-9bd5-d61f53945b3c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:29.552815 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-d77aad66-374e-481c-9bd5-d61f53945b3c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1787a9ef7c44e28076aaa80c0152fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee21a91b84794e80b208fe72b7f1e010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:16:29.562020 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-d77aad66-374e-481c-9bd5-d61f53945b3c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "GET /compute/v2.1/servers/712578d1-d2fb-4252-adbb-bc87096acc00" status: 200 len: 1723 microversion: 2.1 time: 0.158033 Oct 17 03:16:29.562275 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 346/658] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:16:29 2022] GET /compute/v2.1/servers/712578d1-d2fb-4252-adbb-bc87096acc00 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:16:29.900249 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-63f4ad7a-d1ec-411d-9ce0-522369325f59 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:16:29.901359 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-63f4ad7a-d1ec-411d-9ce0-522369325f59 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] [instance: 7b220b35-d9ac-48e4-b898-3d4f6c7be835] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:16:29.908885 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-63f4ad7a-d1ec-411d-9ce0-522369325f59 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:29.909366 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-63f4ad7a-d1ec-411d-9ce0-522369325f59 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:29.909797 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-63f4ad7a-d1ec-411d-9ce0-522369325f59 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:29.910490 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-63f4ad7a-d1ec-411d-9ce0-522369325f59 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:29.910970 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-63f4ad7a-d1ec-411d-9ce0-522369325f59 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:29.911395 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-63f4ad7a-d1ec-411d-9ce0-522369325f59 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:30.207490 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-63f4ad7a-d1ec-411d-9ce0-522369325f59 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce25db99a7b14d0bbaca41fff80e3da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5bad80dc0d74119b2a9cd5c1935e8d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:16:30.216374 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-63f4ad7a-d1ec-411d-9ce0-522369325f59 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] 10.222.0.27 "GET /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835" status: 200 len: 1675 microversion: 2.1 time: 0.321130 Oct 17 03:16:30.217150 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 313/659] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:16:29 2022] GET /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835 => generated 1675 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:16:30.585457 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-6c875646-1935-4a00-81a2-7e14f02712f2 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:16:30.587254 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-6c875646-1935-4a00-81a2-7e14f02712f2 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: 712578d1-d2fb-4252-adbb-bc87096acc00] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:16:30.593928 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-6c875646-1935-4a00-81a2-7e14f02712f2 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:30.594412 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-6c875646-1935-4a00-81a2-7e14f02712f2 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:30.594846 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-6c875646-1935-4a00-81a2-7e14f02712f2 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:30.595567 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-6c875646-1935-4a00-81a2-7e14f02712f2 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:30.596017 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-6c875646-1935-4a00-81a2-7e14f02712f2 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:30.596435 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-6c875646-1935-4a00-81a2-7e14f02712f2 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:30.735745 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-6c875646-1935-4a00-81a2-7e14f02712f2 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1787a9ef7c44e28076aaa80c0152fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee21a91b84794e80b208fe72b7f1e010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:16:30.744860 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-6c875646-1935-4a00-81a2-7e14f02712f2 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "GET /compute/v2.1/servers/712578d1-d2fb-4252-adbb-bc87096acc00" status: 200 len: 1723 microversion: 2.1 time: 0.163288 Oct 17 03:16:30.745438 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 347/660] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:16:30 2022] GET /compute/v2.1/servers/712578d1-d2fb-4252-adbb-bc87096acc00 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:16:30.934726 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [req-23dd21db-a098-4e50-87ee-deabc536a0a1 req-635f1605-1007-4dd3-8ba2-a2ab46d5eef1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b220b35-d9ac-48e4-b898-3d4f6c7be835", "name": "network-vif-deleted", "tag": "cf904496-4f8e-473c-8ea7-795ed5aefe57"}]} {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:16:30.944800 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [req-23dd21db-a098-4e50-87ee-deabc536a0a1 req-635f1605-1007-4dd3-8ba2-a2ab46d5eef1 service nova] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:30.945280 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [req-23dd21db-a098-4e50-87ee-deabc536a0a1 req-635f1605-1007-4dd3-8ba2-a2ab46d5eef1 service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:30.945705 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [req-23dd21db-a098-4e50-87ee-deabc536a0a1 req-635f1605-1007-4dd3-8ba2-a2ab46d5eef1 service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:30.956843 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.compute.server_external_events [req-23dd21db-a098-4e50-87ee-deabc536a0a1 req-635f1605-1007-4dd3-8ba2-a2ab46d5eef1 service nova] Creating event network-vif-deleted:cf904496-4f8e-473c-8ea7-795ed5aefe57 for instance 7b220b35-d9ac-48e4-b898-3d4f6c7be835 on hv-cinder-84697 Oct 17 03:16:30.962025 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [req-23dd21db-a098-4e50-87ee-deabc536a0a1 req-635f1605-1007-4dd3-8ba2-a2ab46d5eef1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031412 Oct 17 03:16:30.963087 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 314/661] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 03:16:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:16:31.241001 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-c4e7a049-bf29-4ee5-a847-8931c5eab286 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:16:31.241565 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-c4e7a049-bf29-4ee5-a847-8931c5eab286 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] [instance: 7b220b35-d9ac-48e4-b898-3d4f6c7be835] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:16:31.249001 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-c4e7a049-bf29-4ee5-a847-8931c5eab286 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:31.249489 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-c4e7a049-bf29-4ee5-a847-8931c5eab286 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:31.249968 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-c4e7a049-bf29-4ee5-a847-8931c5eab286 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:31.250667 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-c4e7a049-bf29-4ee5-a847-8931c5eab286 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:31.251149 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-c4e7a049-bf29-4ee5-a847-8931c5eab286 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:31.251571 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-c4e7a049-bf29-4ee5-a847-8931c5eab286 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:31.318852 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-c4e7a049-bf29-4ee5-a847-8931c5eab286 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce25db99a7b14d0bbaca41fff80e3da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5bad80dc0d74119b2a9cd5c1935e8d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:16:31.326643 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-c4e7a049-bf29-4ee5-a847-8931c5eab286 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] 10.222.0.27 "GET /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835" status: 200 len: 1607 microversion: 2.1 time: 0.089810 Oct 17 03:16:31.327243 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 348/662] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:16:31 2022] GET /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835 => generated 1607 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:16:31.771579 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-c968279b-1eba-4196-be3b-51eb7bee2c96 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:16:31.772279 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-c968279b-1eba-4196-be3b-51eb7bee2c96 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: 712578d1-d2fb-4252-adbb-bc87096acc00] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:16:31.779823 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-c968279b-1eba-4196-be3b-51eb7bee2c96 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:31.780311 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-c968279b-1eba-4196-be3b-51eb7bee2c96 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:31.780737 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-c968279b-1eba-4196-be3b-51eb7bee2c96 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:31.781427 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-c968279b-1eba-4196-be3b-51eb7bee2c96 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:31.781890 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-c968279b-1eba-4196-be3b-51eb7bee2c96 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:31.782286 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-c968279b-1eba-4196-be3b-51eb7bee2c96 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:31.927783 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-c968279b-1eba-4196-be3b-51eb7bee2c96 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1787a9ef7c44e28076aaa80c0152fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee21a91b84794e80b208fe72b7f1e010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:16:31.934402 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG dbcounter [-] [118887] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:16:31.937523 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-c968279b-1eba-4196-be3b-51eb7bee2c96 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "GET /compute/v2.1/servers/712578d1-d2fb-4252-adbb-bc87096acc00" status: 200 len: 1723 microversion: 2.1 time: 0.172649 Oct 17 03:16:31.938151 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 315/663] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:16:31 2022] GET /compute/v2.1/servers/712578d1-d2fb-4252-adbb-bc87096acc00 => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:16:32.349521 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-a3909791-9760-4dfc-85b9-864fc011d154 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:16:32.350128 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-a3909791-9760-4dfc-85b9-864fc011d154 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] [instance: 7b220b35-d9ac-48e4-b898-3d4f6c7be835] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:16:32.357113 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-a3909791-9760-4dfc-85b9-864fc011d154 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:32.357594 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-a3909791-9760-4dfc-85b9-864fc011d154 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:32.358033 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-a3909791-9760-4dfc-85b9-864fc011d154 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:32.358725 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-a3909791-9760-4dfc-85b9-864fc011d154 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:32.359217 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-a3909791-9760-4dfc-85b9-864fc011d154 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:32.359647 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-a3909791-9760-4dfc-85b9-864fc011d154 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:32.391114 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-a3909791-9760-4dfc-85b9-864fc011d154 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:32.391637 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-a3909791-9760-4dfc-85b9-864fc011d154 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:32.392079 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-a3909791-9760-4dfc-85b9-864fc011d154 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:32.392519 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.objects.instance [None req-a3909791-9760-4dfc-85b9-864fc011d154 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lazy-loading 'fault' on Instance uuid 7b220b35-d9ac-48e4-b898-3d4f6c7be835 {{(pid=118886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 03:16:32.433619 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-a3909791-9760-4dfc-85b9-864fc011d154 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce25db99a7b14d0bbaca41fff80e3da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5bad80dc0d74119b2a9cd5c1935e8d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:16:32.442187 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-a3909791-9760-4dfc-85b9-864fc011d154 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] 10.222.0.27 "GET /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835" status: 200 len: 1327 microversion: 2.1 time: 0.096422 Oct 17 03:16:32.442762 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 349/664] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:16:32 2022] GET /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835 => generated 1327 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:16:32.960610 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-ff34763d-7524-4b67-ad29-a962b6bd2679 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:16:32.961190 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-ff34763d-7524-4b67-ad29-a962b6bd2679 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: 712578d1-d2fb-4252-adbb-bc87096acc00] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:16:32.968220 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-ff34763d-7524-4b67-ad29-a962b6bd2679 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:32.968706 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-ff34763d-7524-4b67-ad29-a962b6bd2679 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:32.969129 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-ff34763d-7524-4b67-ad29-a962b6bd2679 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:32.970051 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-ff34763d-7524-4b67-ad29-a962b6bd2679 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:32.970691 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-ff34763d-7524-4b67-ad29-a962b6bd2679 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:32.971353 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-ff34763d-7524-4b67-ad29-a962b6bd2679 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:33.121891 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-ff34763d-7524-4b67-ad29-a962b6bd2679 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1787a9ef7c44e28076aaa80c0152fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee21a91b84794e80b208fe72b7f1e010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:16:33.129912 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-ff34763d-7524-4b67-ad29-a962b6bd2679 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "GET /compute/v2.1/servers/712578d1-d2fb-4252-adbb-bc87096acc00" status: 200 len: 1729 microversion: 2.1 time: 0.173635 Oct 17 03:16:33.130545 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 316/665] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:16:32 2022] GET /compute/v2.1/servers/712578d1-d2fb-4252-adbb-bc87096acc00 => generated 1729 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:16:33.152946 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-785f7b6f-3f28-437a-b312-f3ce68637844 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:16:33.153466 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-785f7b6f-3f28-437a-b312-f3ce68637844 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: 712578d1-d2fb-4252-adbb-bc87096acc00] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:16:33.160870 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-785f7b6f-3f28-437a-b312-f3ce68637844 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:33.161730 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-785f7b6f-3f28-437a-b312-f3ce68637844 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:33.162272 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-785f7b6f-3f28-437a-b312-f3ce68637844 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:33.163036 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-785f7b6f-3f28-437a-b312-f3ce68637844 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:33.163491 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-785f7b6f-3f28-437a-b312-f3ce68637844 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:33.163936 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-785f7b6f-3f28-437a-b312-f3ce68637844 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:33.241245 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-785f7b6f-3f28-437a-b312-f3ce68637844 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "GET /compute/v2.1/servers/712578d1-d2fb-4252-adbb-bc87096acc00/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092939 Oct 17 03:16:33.241842 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 350/666] 10.222.0.27 () {58 vars in 1275 bytes} [Mon Oct 17 03:16:33 2022] GET /compute/v2.1/servers/712578d1-d2fb-4252-adbb-bc87096acc00/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:16:33.465871 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-1619ca35-d3cc-40e2-9d69-86befc9b9082 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:16:33.466468 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-1619ca35-d3cc-40e2-9d69-86befc9b9082 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] [instance: 7b220b35-d9ac-48e4-b898-3d4f6c7be835] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:16:33.472733 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-1619ca35-d3cc-40e2-9d69-86befc9b9082 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:33.473206 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-1619ca35-d3cc-40e2-9d69-86befc9b9082 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:33.473629 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-1619ca35-d3cc-40e2-9d69-86befc9b9082 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:33.474382 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-1619ca35-d3cc-40e2-9d69-86befc9b9082 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:33.474850 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-1619ca35-d3cc-40e2-9d69-86befc9b9082 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:33.475288 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-1619ca35-d3cc-40e2-9d69-86befc9b9082 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:33.489012 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.wsgi [None req-1619ca35-d3cc-40e2-9d69-86befc9b9082 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] HTTP exception thrown: Instance 7b220b35-d9ac-48e4-b898-3d4f6c7be835 could not be found. Oct 17 03:16:33.490640 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-1619ca35-d3cc-40e2-9d69-86befc9b9082 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Request method failure captured: Oct 17 03:16:33.490640 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: request: GET /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835 HTTP/1.1 Oct 17 03:16:33.490640 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Accept: application/json Oct 17 03:16:33.490640 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Accept-Encoding: identity Oct 17 03:16:33.490640 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Connection: close Oct 17 03:16:33.490640 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Content-Length: 0 Oct 17 03:16:33.490640 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Content-Type: application/json Oct 17 03:16:33.490640 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Host: 10.222.0.27 Oct 17 03:16:33.490640 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Openstack-System-Scope: None Oct 17 03:16:33.490640 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: User-Agent: python-urllib3/1.26.12 Oct 17 03:16:33.490640 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Auth-Token: gAAAAABjTMf8JV6UANmoo3RCAe3xHSgPfZQVEBdFiPOEb_yO9Ct8ESAfEcnl03KATLNHNncGiIS4w8OY6GoKRN1y8W0XRxZTqKeCFzVtwZG7Bj3lhhKwcXkyi4Qg3fTqOg5f9fTHbmt5uLBux2T8UAxLVbxjUk77x2aNLLIBADgWKyi7sbgIkng Oct 17 03:16:33.490640 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Domain-Id: None Oct 17 03:16:33.490640 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Domain-Name: None Oct 17 03:16:33.490640 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Identity-Status: Confirmed Oct 17 03:16:33.490640 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Is-Admin-Project: True Oct 17 03:16:33.490640 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Project-Domain-Id: default Oct 17 03:16:33.490640 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Project-Domain-Name: Default Oct 17 03:16:33.490640 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Project-Id: e5bad80dc0d74119b2a9cd5c1935e8d5 Oct 17 03:16:33.490640 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Project-Name: tempest-AttachVolumeTestJSON-1921657918 Oct 17 03:16:33.490640 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Role: member,reader Oct 17 03:16:33.490640 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Roles: member,reader Oct 17 03:16:33.492175 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e5bad80dc0d74119b2a9cd5c1935e8d5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e5bad80dc0d74119b2a9cd5c1935e8d5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e5bad80dc0d74119b2a9cd5c1935e8d5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e5bad80dc0d74119b2a9cd5c1935e8d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 17 03:16:33.492175 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Tenant: tempest-AttachVolumeTestJSON-1921657918 Oct 17 03:16:33.492175 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Tenant-Id: e5bad80dc0d74119b2a9cd5c1935e8d5 Oct 17 03:16:33.492175 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1921657918 Oct 17 03:16:33.492175 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-User: tempest-AttachVolumeTestJSON-1921657918-project Oct 17 03:16:33.492175 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-User-Domain-Id: default Oct 17 03:16:33.492175 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-User-Domain-Name: Default Oct 17 03:16:33.492175 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-User-Id: ce25db99a7b14d0bbaca41fff80e3da9 Oct 17 03:16:33.492175 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-User-Name: tempest-AttachVolumeTestJSON-1921657918-project Oct 17 03:16:33.492175 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: method: > Oct 17 03:16:33.492175 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: exception: Instance 7b220b35-d9ac-48e4-b898-3d4f6c7be835 could not be found. Oct 17 03:16:33.492175 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: action_args: {'id': '7b220b35-d9ac-48e4-b898-3d4f6c7be835'} Oct 17 03:16:33.493010 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 03:16:33.493010 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:16:33.493010 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 03:16:33.493010 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 03:16:33.493010 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 03:16:33.493010 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 03:16:33.493010 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 03:16:33.493010 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 03:16:33.493010 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 03:16:33.493010 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 03:16:33.493010 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b220b35-d9ac-48e4-b898-3d4f6c7be835 could not be found. Oct 17 03:16:33.493010 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Oct 17 03:16:33.493010 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:16:33.493010 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Oct 17 03:16:33.493010 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:16:33.493010 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:16:33.493010 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:16:33.493010 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 03:16:33.493010 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 03:16:33.493010 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 03:16:33.494349 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 03:16:33.494349 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 03:16:33.494349 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 03:16:33.494349 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 03:16:33.494349 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 03:16:33.494349 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 03:16:33.494349 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 03:16:33.494349 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b220b35-d9ac-48e4-b898-3d4f6c7be835 could not be found. Oct 17 03:16:33.494349 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Oct 17 03:16:33.494349 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:16:33.494349 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Oct 17 03:16:33.494349 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:16:33.494349 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:16:33.494349 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:16:33.494349 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 03:16:33.494349 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 03:16:33.494349 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b220b35-d9ac-48e4-b898-3d4f6c7be835 could not be found. Oct 17 03:16:33.494349 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Oct 17 03:16:33.495522 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-1619ca35-d3cc-40e2-9d69-86befc9b9082 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Returning 404 to user: Instance 7b220b35-d9ac-48e4-b898-3d4f6c7be835 could not be found. {{(pid=118887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 03:16:33.495522 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-1619ca35-d3cc-40e2-9d69-86befc9b9082 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] 10.222.0.27 "GET /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835" status: 404 len: 111 microversion: 2.1 time: 0.030705 Oct 17 03:16:33.495522 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 317/667] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:16:33 2022] GET /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 03:16:33.503200 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-def62fb5-6e38-422a-910c-19c291cc6477 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Calling method '.version_select at 0x7fc7016bf700>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:16:33.523349 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-def62fb5-6e38-422a-910c-19c291cc6477 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-463363565" status: 202 len: 0 microversion: 2.1 time: 0.026030 Oct 17 03:16:33.524612 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 351/668] 10.222.0.27 () {58 vars in 1218 bytes} [Mon Oct 17 03:16:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-463363565 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 03:16:34.172124 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [req-26295e40-d34c-4a5b-80ba-9e12b672887a req-dab1fc76-d39f-4179-bbd9-1a82cb6d5233 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "712578d1-d2fb-4252-adbb-bc87096acc00", "tag": "f7a1e8a6-f7aa-40af-a627-0640f636cc4a"}]} {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:16:34.182432 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [req-26295e40-d34c-4a5b-80ba-9e12b672887a req-dab1fc76-d39f-4179-bbd9-1a82cb6d5233 service nova] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:34.183343 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [req-26295e40-d34c-4a5b-80ba-9e12b672887a req-dab1fc76-d39f-4179-bbd9-1a82cb6d5233 service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:34.183929 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [req-26295e40-d34c-4a5b-80ba-9e12b672887a req-dab1fc76-d39f-4179-bbd9-1a82cb6d5233 service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:34.188842 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-17c00e4c-c274-449a-be95-9f35ec511219 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Action: 'create', calling method: .version_select at 0x7fc7016dfd30>, body: {"keypair": {"name": "tempest-keypair-1036338029", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJhbCuowdisBId/Hzt70p4WbZVPvTY8ZVTiLctVsEXJP4WzuRgFaXURLB9ZJ2zH6jADtfboLlz7E6RahQD+OWaSq5Hz0a3XxgdOnvkCUCDMWAHjz26bZXTm+hqGXB1YQeA=="}} {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:16:34.197520 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.compute.server_external_events [req-26295e40-d34c-4a5b-80ba-9e12b672887a req-dab1fc76-d39f-4179-bbd9-1a82cb6d5233 service nova] Creating event network-changed:f7a1e8a6-f7aa-40af-a627-0640f636cc4a for instance 712578d1-d2fb-4252-adbb-bc87096acc00 on hv-cinder-84697 Oct 17 03:16:34.203052 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [req-26295e40-d34c-4a5b-80ba-9e12b672887a req-dab1fc76-d39f-4179-bbd9-1a82cb6d5233 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034395 Oct 17 03:16:34.204293 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 318/669] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 03:16:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:16:34.209928 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.quota [None req-17c00e4c-c274-449a-be95-9f35ec511219 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Getting quotas for project e5bad80dc0d74119b2a9cd5c1935e8d5. Resources: {'key_pairs'} {{(pid=118886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 03:16:34.214717 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.quota [None req-17c00e4c-c274-449a-be95-9f35ec511219 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Getting quotas for user ce25db99a7b14d0bbaca41fff80e3da9 and project e5bad80dc0d74119b2a9cd5c1935e8d5. Resources: {'key_pairs'} {{(pid=118886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 03:16:34.241017 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-17c00e4c-c274-449a-be95-9f35ec511219 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.056025 Oct 17 03:16:34.242290 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 352/670] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 17 03:16:34 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:16:35.660956 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-1b6b1e1d-1606-4acc-a0e6-2bcdef35756c tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1410158165", "imageRef": "e6d41914-f1bc-4b72-9113-1a69b3d0d83b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b76b6d47-52a1-4c1b-a84c-d9fcfdadba83"}], "security_groups": [{"name": "tempest-securitygroup--454181173"}], "key_name": "tempest-keypair-1036338029", "user_data": "}} {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:16:35.768080 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.network.neutron [None req-1b6b1e1d-1606-4acc-a0e6-2bcdef35756c tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] validate_networks() for [('b76b6d47-52a1-4c1b-a84c-d9fcfdadba83', None, None, None, None, None)] {{(pid=118887) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 03:16:36.219975 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [req-f26ed7b8-7422-423c-8349-5df1520a4539 req-e7633f6d-38e4-4590-a7ad-c16b0ae8ff25 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "712578d1-d2fb-4252-adbb-bc87096acc00", "tag": "f7a1e8a6-f7aa-40af-a627-0640f636cc4a"}]} {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:16:36.230417 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [req-f26ed7b8-7422-423c-8349-5df1520a4539 req-e7633f6d-38e4-4590-a7ad-c16b0ae8ff25 service nova] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:36.230914 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [req-f26ed7b8-7422-423c-8349-5df1520a4539 req-e7633f6d-38e4-4590-a7ad-c16b0ae8ff25 service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:36.231338 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [req-f26ed7b8-7422-423c-8349-5df1520a4539 req-e7633f6d-38e4-4590-a7ad-c16b0ae8ff25 service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:36.242623 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.compute.server_external_events [req-f26ed7b8-7422-423c-8349-5df1520a4539 req-e7633f6d-38e4-4590-a7ad-c16b0ae8ff25 service nova] Creating event network-changed:f7a1e8a6-f7aa-40af-a627-0640f636cc4a for instance 712578d1-d2fb-4252-adbb-bc87096acc00 on hv-cinder-84697 Oct 17 03:16:36.248638 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [req-f26ed7b8-7422-423c-8349-5df1520a4539 req-e7633f6d-38e4-4590-a7ad-c16b0ae8ff25 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032762 Oct 17 03:16:36.249269 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 353/671] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 03:16:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:16:36.487621 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.virt.hardware [None req-1b6b1e1d-1606-4acc-a0e6-2bcdef35756c tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Flavor limits 0:0:0 {{(pid=118887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 03:16:36.488084 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.virt.hardware [None req-1b6b1e1d-1606-4acc-a0e6-2bcdef35756c tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Image limits 0:0:0 {{(pid=118887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 03:16:36.488584 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.virt.hardware [None req-1b6b1e1d-1606-4acc-a0e6-2bcdef35756c tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Flavor pref 0:0:0 {{(pid=118887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 03:16:36.489020 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.virt.hardware [None req-1b6b1e1d-1606-4acc-a0e6-2bcdef35756c tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Image pref 0:0:0 {{(pid=118887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 03:16:36.489433 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.virt.hardware [None req-1b6b1e1d-1606-4acc-a0e6-2bcdef35756c tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 03:16:36.499073 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-1b6b1e1d-1606-4acc-a0e6-2bcdef35756c tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:36.499555 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-1b6b1e1d-1606-4acc-a0e6-2bcdef35756c tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:36.499998 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-1b6b1e1d-1606-4acc-a0e6-2bcdef35756c tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:36.500730 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-1b6b1e1d-1606-4acc-a0e6-2bcdef35756c tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:36.501185 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-1b6b1e1d-1606-4acc-a0e6-2bcdef35756c tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:36.501611 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-1b6b1e1d-1606-4acc-a0e6-2bcdef35756c tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:36.519005 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.quota [None req-1b6b1e1d-1606-4acc-a0e6-2bcdef35756c tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Getting quotas for project e5bad80dc0d74119b2a9cd5c1935e8d5. Resources: {'instances', 'cores', 'ram'} {{(pid=118887) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 03:16:36.523020 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.quota [None req-1b6b1e1d-1606-4acc-a0e6-2bcdef35756c tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Getting quotas for user ce25db99a7b14d0bbaca41fff80e3da9 and project e5bad80dc0d74119b2a9cd5c1935e8d5. Resources: {'instances', 'cores', 'ram'} {{(pid=118887) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 03:16:36.535075 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-1b6b1e1d-1606-4acc-a0e6-2bcdef35756c tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Going to run 1 instances... {{(pid=118887) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 03:16:36.537478 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-1b6b1e1d-1606-4acc-a0e6-2bcdef35756c tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] [instance: b63b8f22-1f05-418e-b804-010e3d5cd2ae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e6d41914-f1bc-4b72-9113-1a69b3d0d83b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118887) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 03:16:36.590444 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-1b6b1e1d-1606-4acc-a0e6-2bcdef35756c tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.934665 Oct 17 03:16:36.591506 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 319/672] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 03:16:35 2022] POST /compute/v2.1/servers => generated 401 bytes in 936 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 03:16:36.603424 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-c209684a-eb68-48c5-8efd-b3eb9d51357b tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:16:36.604510 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-c209684a-eb68-48c5-8efd-b3eb9d51357b tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] [instance: b63b8f22-1f05-418e-b804-010e3d5cd2ae] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:16:36.671962 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-c209684a-eb68-48c5-8efd-b3eb9d51357b tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce25db99a7b14d0bbaca41fff80e3da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5bad80dc0d74119b2a9cd5c1935e8d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:16:36.679035 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-c209684a-eb68-48c5-8efd-b3eb9d51357b tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] 10.222.0.27 "GET /compute/v2.1/servers/b63b8f22-1f05-418e-b804-010e3d5cd2ae" status: 200 len: 1238 microversion: 2.1 time: 0.080645 Oct 17 03:16:36.680030 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 354/673] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:16:36 2022] GET /compute/v2.1/servers/b63b8f22-1f05-418e-b804-010e3d5cd2ae => generated 1238 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:16:37.702647 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-85605c6d-b8c6-4f99-af9e-f84fcbed8f41 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:16:37.703273 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-85605c6d-b8c6-4f99-af9e-f84fcbed8f41 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] [instance: b63b8f22-1f05-418e-b804-010e3d5cd2ae] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:16:37.709570 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-85605c6d-b8c6-4f99-af9e-f84fcbed8f41 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:37.710040 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-85605c6d-b8c6-4f99-af9e-f84fcbed8f41 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:37.710469 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-85605c6d-b8c6-4f99-af9e-f84fcbed8f41 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:37.711214 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-85605c6d-b8c6-4f99-af9e-f84fcbed8f41 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:37.711689 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-85605c6d-b8c6-4f99-af9e-f84fcbed8f41 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:37.712110 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-85605c6d-b8c6-4f99-af9e-f84fcbed8f41 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:37.967630 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-85605c6d-b8c6-4f99-af9e-f84fcbed8f41 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce25db99a7b14d0bbaca41fff80e3da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5bad80dc0d74119b2a9cd5c1935e8d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:16:37.979600 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-85605c6d-b8c6-4f99-af9e-f84fcbed8f41 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] 10.222.0.27 "GET /compute/v2.1/servers/b63b8f22-1f05-418e-b804-010e3d5cd2ae" status: 200 len: 1290 microversion: 2.1 time: 0.278492 Oct 17 03:16:37.985623 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 320/674] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:16:37 2022] GET /compute/v2.1/servers/b63b8f22-1f05-418e-b804-010e3d5cd2ae => generated 1290 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:16:39.003571 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-06712803-5b9e-4650-82ee-635be1f0dffa tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:16:39.004340 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-06712803-5b9e-4650-82ee-635be1f0dffa tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] [instance: b63b8f22-1f05-418e-b804-010e3d5cd2ae] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:16:39.011822 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-06712803-5b9e-4650-82ee-635be1f0dffa tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:39.012303 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-06712803-5b9e-4650-82ee-635be1f0dffa tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:39.012737 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-06712803-5b9e-4650-82ee-635be1f0dffa tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:39.013428 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-06712803-5b9e-4650-82ee-635be1f0dffa tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:39.013909 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-06712803-5b9e-4650-82ee-635be1f0dffa tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:39.014332 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-06712803-5b9e-4650-82ee-635be1f0dffa tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:39.035032 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG dbcounter [-] [118886] Writing DB stats nova_cell1:SELECT=100 {{(pid=118886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:16:39.211381 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-06712803-5b9e-4650-82ee-635be1f0dffa tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce25db99a7b14d0bbaca41fff80e3da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5bad80dc0d74119b2a9cd5c1935e8d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:16:39.224202 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-06712803-5b9e-4650-82ee-635be1f0dffa tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] 10.222.0.27 "GET /compute/v2.1/servers/b63b8f22-1f05-418e-b804-010e3d5cd2ae" status: 200 len: 1363 microversion: 2.1 time: 0.224470 Oct 17 03:16:39.225026 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 355/675] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:16:38 2022] GET /compute/v2.1/servers/b63b8f22-1f05-418e-b804-010e3d5cd2ae => generated 1363 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:16:39.271139 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [req-9d2030e8-96a4-4532-a3bd-a7787dfaa95c req-1e15b00a-47f8-4203-a354-4e1275e4f4e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b63b8f22-1f05-418e-b804-010e3d5cd2ae", "tag": "03d98863-7bf9-4161-be90-1840be834ea7"}]} {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:16:39.282419 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [req-9d2030e8-96a4-4532-a3bd-a7787dfaa95c req-1e15b00a-47f8-4203-a354-4e1275e4f4e5 service nova] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:39.283970 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [req-9d2030e8-96a4-4532-a3bd-a7787dfaa95c req-1e15b00a-47f8-4203-a354-4e1275e4f4e5 service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:39.284599 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [req-9d2030e8-96a4-4532-a3bd-a7787dfaa95c req-1e15b00a-47f8-4203-a354-4e1275e4f4e5 service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:39.297083 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.compute.server_external_events [req-9d2030e8-96a4-4532-a3bd-a7787dfaa95c req-1e15b00a-47f8-4203-a354-4e1275e4f4e5 service nova] Creating event network-changed:03d98863-7bf9-4161-be90-1840be834ea7 for instance b63b8f22-1f05-418e-b804-010e3d5cd2ae on hv-cinder-84697 Oct 17 03:16:39.302092 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [req-9d2030e8-96a4-4532-a3bd-a7787dfaa95c req-1e15b00a-47f8-4203-a354-4e1275e4f4e5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034813 Oct 17 03:16:39.303027 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 321/676] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 03:16:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:16:40.247303 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-54879b7c-1953-4e50-a161-ed6061a2c720 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:16:40.247907 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-54879b7c-1953-4e50-a161-ed6061a2c720 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] [instance: b63b8f22-1f05-418e-b804-010e3d5cd2ae] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:16:40.254384 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-54879b7c-1953-4e50-a161-ed6061a2c720 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:40.254895 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-54879b7c-1953-4e50-a161-ed6061a2c720 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:40.255332 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-54879b7c-1953-4e50-a161-ed6061a2c720 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:40.256022 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-54879b7c-1953-4e50-a161-ed6061a2c720 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:40.256475 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-54879b7c-1953-4e50-a161-ed6061a2c720 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:40.256897 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-54879b7c-1953-4e50-a161-ed6061a2c720 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:40.385160 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-54879b7c-1953-4e50-a161-ed6061a2c720 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce25db99a7b14d0bbaca41fff80e3da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5bad80dc0d74119b2a9cd5c1935e8d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:16:40.392740 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-54879b7c-1953-4e50-a161-ed6061a2c720 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] 10.222.0.27 "GET /compute/v2.1/servers/b63b8f22-1f05-418e-b804-010e3d5cd2ae" status: 200 len: 1363 microversion: 2.1 time: 0.149337 Oct 17 03:16:40.393307 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 356/677] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:16:40 2022] GET /compute/v2.1/servers/b63b8f22-1f05-418e-b804-010e3d5cd2ae => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:16:41.417170 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-61c84b7e-5d51-46cf-b482-ca3a8153a60e tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:16:41.417870 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-61c84b7e-5d51-46cf-b482-ca3a8153a60e tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] [instance: b63b8f22-1f05-418e-b804-010e3d5cd2ae] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:16:41.424069 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-61c84b7e-5d51-46cf-b482-ca3a8153a60e tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:41.424550 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-61c84b7e-5d51-46cf-b482-ca3a8153a60e tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:41.424985 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-61c84b7e-5d51-46cf-b482-ca3a8153a60e tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:41.425674 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-61c84b7e-5d51-46cf-b482-ca3a8153a60e tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:41.426128 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-61c84b7e-5d51-46cf-b482-ca3a8153a60e tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:41.426553 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-61c84b7e-5d51-46cf-b482-ca3a8153a60e tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:41.554977 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-61c84b7e-5d51-46cf-b482-ca3a8153a60e tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce25db99a7b14d0bbaca41fff80e3da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5bad80dc0d74119b2a9cd5c1935e8d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:16:41.563164 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-61c84b7e-5d51-46cf-b482-ca3a8153a60e tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] 10.222.0.27 "GET /compute/v2.1/servers/b63b8f22-1f05-418e-b804-010e3d5cd2ae" status: 200 len: 1363 microversion: 2.1 time: 0.151111 Oct 17 03:16:41.563716 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 322/678] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:16:41 2022] GET /compute/v2.1/servers/b63b8f22-1f05-418e-b804-010e3d5cd2ae => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:16:42.585512 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-3ed2a08c-be36-402b-a780-5e7ad474e725 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:16:42.586211 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-3ed2a08c-be36-402b-a780-5e7ad474e725 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] [instance: b63b8f22-1f05-418e-b804-010e3d5cd2ae] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:16:42.593422 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-3ed2a08c-be36-402b-a780-5e7ad474e725 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:42.593906 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-3ed2a08c-be36-402b-a780-5e7ad474e725 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:42.594396 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-3ed2a08c-be36-402b-a780-5e7ad474e725 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:42.595152 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-3ed2a08c-be36-402b-a780-5e7ad474e725 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:42.595606 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-3ed2a08c-be36-402b-a780-5e7ad474e725 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:42.596033 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-3ed2a08c-be36-402b-a780-5e7ad474e725 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:42.724864 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-3ed2a08c-be36-402b-a780-5e7ad474e725 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce25db99a7b14d0bbaca41fff80e3da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5bad80dc0d74119b2a9cd5c1935e8d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:16:42.733330 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-3ed2a08c-be36-402b-a780-5e7ad474e725 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] 10.222.0.27 "GET /compute/v2.1/servers/b63b8f22-1f05-418e-b804-010e3d5cd2ae" status: 200 len: 1363 microversion: 2.1 time: 0.151647 Oct 17 03:16:42.733897 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 357/679] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:16:42 2022] GET /compute/v2.1/servers/b63b8f22-1f05-418e-b804-010e3d5cd2ae => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:16:43.755154 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-16a60fd5-b111-4f50-a3b2-bb1319c70e6a tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:16:43.755752 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-16a60fd5-b111-4f50-a3b2-bb1319c70e6a tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] [instance: b63b8f22-1f05-418e-b804-010e3d5cd2ae] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:16:43.762105 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-16a60fd5-b111-4f50-a3b2-bb1319c70e6a tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:43.762578 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-16a60fd5-b111-4f50-a3b2-bb1319c70e6a tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:43.763030 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-16a60fd5-b111-4f50-a3b2-bb1319c70e6a tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:43.763718 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-16a60fd5-b111-4f50-a3b2-bb1319c70e6a tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:43.764193 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-16a60fd5-b111-4f50-a3b2-bb1319c70e6a tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:43.764612 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-16a60fd5-b111-4f50-a3b2-bb1319c70e6a tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:43.895256 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-16a60fd5-b111-4f50-a3b2-bb1319c70e6a tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce25db99a7b14d0bbaca41fff80e3da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5bad80dc0d74119b2a9cd5c1935e8d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:16:43.903257 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-16a60fd5-b111-4f50-a3b2-bb1319c70e6a tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] 10.222.0.27 "GET /compute/v2.1/servers/b63b8f22-1f05-418e-b804-010e3d5cd2ae" status: 200 len: 1363 microversion: 2.1 time: 0.151931 Oct 17 03:16:43.903815 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 323/680] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:16:43 2022] GET /compute/v2.1/servers/b63b8f22-1f05-418e-b804-010e3d5cd2ae => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:16:44.361655 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-c041752a-19ae-4848-bbb7-b7bcc505199c tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:16:44.362175 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-c041752a-19ae-4848-bbb7-b7bcc505199c tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] [instance: d521fa69-4f04-4d79-8a81-22b2e4bafbae] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:16:44.368947 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-c041752a-19ae-4848-bbb7-b7bcc505199c tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:44.369425 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-c041752a-19ae-4848-bbb7-b7bcc505199c tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:44.369859 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-c041752a-19ae-4848-bbb7-b7bcc505199c tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:44.370586 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-c041752a-19ae-4848-bbb7-b7bcc505199c tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:44.371070 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-c041752a-19ae-4848-bbb7-b7bcc505199c tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:44.371496 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-c041752a-19ae-4848-bbb7-b7bcc505199c tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:44.394428 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-c041752a-19ae-4848-bbb7-b7bcc505199c tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] 10.222.0.27 "GET /compute/v2.1/servers/d521fa69-4f04-4d79-8a81-22b2e4bafbae/ips" status: 200 len: 150 microversion: 2.1 time: 0.036645 Oct 17 03:16:44.395072 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 358/681] 10.222.0.27 () {58 vars in 1248 bytes} [Mon Oct 17 03:16:44 2022] GET /compute/v2.1/servers/d521fa69-4f04-4d79-8a81-22b2e4bafbae/ips => generated 150 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:16:44.763415 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [req-804e4800-1332-4e2c-a456-88229821a367 req-11f11c1d-93f1-4022-bbf2-c39c8da262b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b63b8f22-1f05-418e-b804-010e3d5cd2ae", "name": "network-vif-plugged", "status": "completed", "tag": "03d98863-7bf9-4161-be90-1840be834ea7"}]} {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:16:44.773678 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [req-804e4800-1332-4e2c-a456-88229821a367 req-11f11c1d-93f1-4022-bbf2-c39c8da262b8 service nova] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:44.774433 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [req-804e4800-1332-4e2c-a456-88229821a367 req-11f11c1d-93f1-4022-bbf2-c39c8da262b8 service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:44.774802 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [req-804e4800-1332-4e2c-a456-88229821a367 req-11f11c1d-93f1-4022-bbf2-c39c8da262b8 service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:44.786195 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.compute.server_external_events [req-804e4800-1332-4e2c-a456-88229821a367 req-11f11c1d-93f1-4022-bbf2-c39c8da262b8 service nova] Creating event network-vif-plugged:03d98863-7bf9-4161-be90-1840be834ea7 for instance b63b8f22-1f05-418e-b804-010e3d5cd2ae on hv-cinder-84697 Oct 17 03:16:44.791443 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [req-804e4800-1332-4e2c-a456-88229821a367 req-11f11c1d-93f1-4022-bbf2-c39c8da262b8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032978 Oct 17 03:16:44.792209 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 324/682] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 03:16:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:16:44.926441 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-cbc842cd-6502-4526-afc1-eb2e1deb6a4e tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:16:44.927070 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-cbc842cd-6502-4526-afc1-eb2e1deb6a4e tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] [instance: b63b8f22-1f05-418e-b804-010e3d5cd2ae] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:16:44.933490 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-cbc842cd-6502-4526-afc1-eb2e1deb6a4e tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:44.933962 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-cbc842cd-6502-4526-afc1-eb2e1deb6a4e tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:44.935456 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-cbc842cd-6502-4526-afc1-eb2e1deb6a4e tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:44.936178 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-cbc842cd-6502-4526-afc1-eb2e1deb6a4e tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:44.936638 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-cbc842cd-6502-4526-afc1-eb2e1deb6a4e tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:44.937063 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-cbc842cd-6502-4526-afc1-eb2e1deb6a4e tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:45.067445 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-cbc842cd-6502-4526-afc1-eb2e1deb6a4e tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce25db99a7b14d0bbaca41fff80e3da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5bad80dc0d74119b2a9cd5c1935e8d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:16:45.075596 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-cbc842cd-6502-4526-afc1-eb2e1deb6a4e tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] 10.222.0.27 "GET /compute/v2.1/servers/b63b8f22-1f05-418e-b804-010e3d5cd2ae" status: 200 len: 1363 microversion: 2.1 time: 0.153250 Oct 17 03:16:45.076155 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 359/683] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:16:44 2022] GET /compute/v2.1/servers/b63b8f22-1f05-418e-b804-010e3d5cd2ae => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:16:45.751886 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-51e924c7-4387-48cb-b860-44e501255233 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e95edcd0-aeeb-4b4d-a407-c6a32f39ef38"}} {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:16:45.754282 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-51e924c7-4387-48cb-b860-44e501255233 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] [instance: d521fa69-4f04-4d79-8a81-22b2e4bafbae] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:16:45.761858 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-51e924c7-4387-48cb-b860-44e501255233 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:45.762333 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-51e924c7-4387-48cb-b860-44e501255233 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:45.762767 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-51e924c7-4387-48cb-b860-44e501255233 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:45.763525 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-51e924c7-4387-48cb-b860-44e501255233 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:45.764056 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-51e924c7-4387-48cb-b860-44e501255233 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:45.764422 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-51e924c7-4387-48cb-b860-44e501255233 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:46.003976 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-51e924c7-4387-48cb-b860-44e501255233 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] 10.222.0.27 "POST /compute/v2.1/servers/d521fa69-4f04-4d79-8a81-22b2e4bafbae/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.256171 Oct 17 03:16:46.004590 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 325/684] 10.222.0.27 () {60 vars in 1323 bytes} [Mon Oct 17 03:16:45 2022] POST /compute/v2.1/servers/d521fa69-4f04-4d79-8a81-22b2e4bafbae/os-volume_attachments => generated 194 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:16:46.098886 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-ae246fb1-c697-4f47-a906-674f2342b8c6 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:16:46.099580 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-ae246fb1-c697-4f47-a906-674f2342b8c6 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] [instance: b63b8f22-1f05-418e-b804-010e3d5cd2ae] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:16:46.106442 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-ae246fb1-c697-4f47-a906-674f2342b8c6 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:46.106954 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-ae246fb1-c697-4f47-a906-674f2342b8c6 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:46.107397 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-ae246fb1-c697-4f47-a906-674f2342b8c6 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:46.108113 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-ae246fb1-c697-4f47-a906-674f2342b8c6 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:46.108565 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-ae246fb1-c697-4f47-a906-674f2342b8c6 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:46.108990 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-ae246fb1-c697-4f47-a906-674f2342b8c6 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:46.240723 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-ae246fb1-c697-4f47-a906-674f2342b8c6 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce25db99a7b14d0bbaca41fff80e3da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5bad80dc0d74119b2a9cd5c1935e8d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:16:46.248750 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-ae246fb1-c697-4f47-a906-674f2342b8c6 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] 10.222.0.27 "GET /compute/v2.1/servers/b63b8f22-1f05-418e-b804-010e3d5cd2ae" status: 200 len: 1363 microversion: 2.1 time: 0.153656 Oct 17 03:16:46.249314 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 360/685] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:16:46 2022] GET /compute/v2.1/servers/b63b8f22-1f05-418e-b804-010e3d5cd2ae => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:16:47.269340 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG dbcounter [-] [118887] Writing DB stats nova_cell0:SELECT=2 {{(pid=118887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:16:47.270085 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG dbcounter [-] [118887] Writing DB stats nova_cell0:SELECT=6 {{(pid=118887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:16:47.275222 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-6f9e7c54-f93c-485d-87d1-1c960f99236b tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:16:47.275911 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-6f9e7c54-f93c-485d-87d1-1c960f99236b tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] [instance: b63b8f22-1f05-418e-b804-010e3d5cd2ae] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:16:47.282991 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-6f9e7c54-f93c-485d-87d1-1c960f99236b tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:47.283744 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-6f9e7c54-f93c-485d-87d1-1c960f99236b tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:47.284167 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-6f9e7c54-f93c-485d-87d1-1c960f99236b tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:47.284874 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-6f9e7c54-f93c-485d-87d1-1c960f99236b tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:47.285297 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-6f9e7c54-f93c-485d-87d1-1c960f99236b tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:47.285710 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-6f9e7c54-f93c-485d-87d1-1c960f99236b tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:47.421633 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-6f9e7c54-f93c-485d-87d1-1c960f99236b tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce25db99a7b14d0bbaca41fff80e3da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5bad80dc0d74119b2a9cd5c1935e8d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:16:47.429433 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-6f9e7c54-f93c-485d-87d1-1c960f99236b tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] 10.222.0.27 "GET /compute/v2.1/servers/b63b8f22-1f05-418e-b804-010e3d5cd2ae" status: 200 len: 1549 microversion: 2.1 time: 0.161444 Oct 17 03:16:47.429988 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 326/686] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:16:47 2022] GET /compute/v2.1/servers/b63b8f22-1f05-418e-b804-010e3d5cd2ae => generated 1549 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:16:47.453575 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-214d0b0a-a7e2-4580-802d-796a86b1d9a4 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:16:47.454140 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-214d0b0a-a7e2-4580-802d-796a86b1d9a4 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] [instance: b63b8f22-1f05-418e-b804-010e3d5cd2ae] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:16:47.456025 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG dbcounter [-] [118886] Writing DB stats nova_cell0:SELECT=6 {{(pid=118886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:16:47.463027 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-214d0b0a-a7e2-4580-802d-796a86b1d9a4 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:47.463876 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-214d0b0a-a7e2-4580-802d-796a86b1d9a4 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:47.463975 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-214d0b0a-a7e2-4580-802d-796a86b1d9a4 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:47.464627 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-214d0b0a-a7e2-4580-802d-796a86b1d9a4 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:47.465086 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-214d0b0a-a7e2-4580-802d-796a86b1d9a4 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:47.465511 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-214d0b0a-a7e2-4580-802d-796a86b1d9a4 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:47.546382 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-214d0b0a-a7e2-4580-802d-796a86b1d9a4 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] 10.222.0.27 "GET /compute/v2.1/servers/b63b8f22-1f05-418e-b804-010e3d5cd2ae/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.097018 Oct 17 03:16:47.547254 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 361/687] 10.222.0.27 () {58 vars in 1275 bytes} [Mon Oct 17 03:16:47 2022] GET /compute/v2.1/servers/b63b8f22-1f05-418e-b804-010e3d5cd2ae/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:16:48.464305 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [req-9b6498fb-6adb-40cd-80a6-4bdd349ef538 req-a2f48e85-7cb2-42d8-8ec2-442a9fe61b5d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b63b8f22-1f05-418e-b804-010e3d5cd2ae", "tag": "03d98863-7bf9-4161-be90-1840be834ea7"}]} {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:16:48.474212 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [req-9b6498fb-6adb-40cd-80a6-4bdd349ef538 req-a2f48e85-7cb2-42d8-8ec2-442a9fe61b5d service nova] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:48.474806 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [req-9b6498fb-6adb-40cd-80a6-4bdd349ef538 req-a2f48e85-7cb2-42d8-8ec2-442a9fe61b5d service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:48.475290 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [req-9b6498fb-6adb-40cd-80a6-4bdd349ef538 req-a2f48e85-7cb2-42d8-8ec2-442a9fe61b5d service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:48.486365 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.compute.server_external_events [req-9b6498fb-6adb-40cd-80a6-4bdd349ef538 req-a2f48e85-7cb2-42d8-8ec2-442a9fe61b5d service nova] Creating event network-changed:03d98863-7bf9-4161-be90-1840be834ea7 for instance b63b8f22-1f05-418e-b804-010e3d5cd2ae on hv-cinder-84697 Oct 17 03:16:48.491472 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [req-9b6498fb-6adb-40cd-80a6-4bdd349ef538 req-a2f48e85-7cb2-42d8-8ec2-442a9fe61b5d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030783 Oct 17 03:16:48.492068 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 327/688] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 03:16:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:16:53.558020 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-b68a7c85-e970-4d80-9846-8cd73df7deaa tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e95edcd0-aeeb-4b4d-a407-c6a32f39ef38"}} {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:16:53.560434 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-b68a7c85-e970-4d80-9846-8cd73df7deaa tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] [instance: d521fa69-4f04-4d79-8a81-22b2e4bafbae] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:16:53.566504 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-b68a7c85-e970-4d80-9846-8cd73df7deaa tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:53.567024 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-b68a7c85-e970-4d80-9846-8cd73df7deaa tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:53.567485 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-b68a7c85-e970-4d80-9846-8cd73df7deaa tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:53.568196 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-b68a7c85-e970-4d80-9846-8cd73df7deaa tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:53.568646 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-b68a7c85-e970-4d80-9846-8cd73df7deaa tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:53.569070 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-b68a7c85-e970-4d80-9846-8cd73df7deaa tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:53.648993 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.wsgi [None req-b68a7c85-e970-4d80-9846-8cd73df7deaa tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] HTTP exception thrown: Invalid volume: volume e95edcd0-aeeb-4b4d-a407-c6a32f39ef38 is already attached to instances: d521fa69-4f04-4d79-8a81-22b2e4bafbae Oct 17 03:16:53.650789 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-b68a7c85-e970-4d80-9846-8cd73df7deaa tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Request method failure captured: Oct 17 03:16:53.650789 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: request: POST /compute/v2.1/servers/d521fa69-4f04-4d79-8a81-22b2e4bafbae/os-volume_attachments HTTP/1.1 Oct 17 03:16:53.650789 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Accept: application/json Oct 17 03:16:53.650789 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Accept-Encoding: identity Oct 17 03:16:53.650789 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Connection: close Oct 17 03:16:53.650789 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Content-Length: 74 Oct 17 03:16:53.650789 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Content-Type: application/json Oct 17 03:16:53.650789 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Host: 10.222.0.27 Oct 17 03:16:53.650789 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Openstack-System-Scope: None Oct 17 03:16:53.650789 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: User-Agent: python-urllib3/1.26.12 Oct 17 03:16:53.650789 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Auth-Token: gAAAAABjTMf-SpDw6REUqxlSOIvhtlgFxCyi7gugHXw9249WtXgpgYG8a0yyM9JbvLErgztKU1aaT378mlFtg9Uhrjdru2uD9-W4FJ-CkFLSVPWuyDvIf6q3m3rDvz5qZHkGg2K6V9p96rkOt2BGqAhrNrGmStKoZpndwIVbln6Rg2eRSFSEBDA Oct 17 03:16:53.650789 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Domain-Id: None Oct 17 03:16:53.650789 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Domain-Name: None Oct 17 03:16:53.650789 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Identity-Status: Confirmed Oct 17 03:16:53.650789 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Is-Admin-Project: True Oct 17 03:16:53.650789 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Project-Domain-Id: default Oct 17 03:16:53.650789 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Project-Domain-Name: Default Oct 17 03:16:53.650789 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Project-Id: 618cf0b3507845909bb27c13460d1d6c Oct 17 03:16:53.650789 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Project-Name: tempest-AttachVolumeNegativeTest-816799241 Oct 17 03:16:53.650789 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Role: member,reader Oct 17 03:16:53.650789 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Roles: member,reader Oct 17 03:16:53.652361 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/618cf0b3507845909bb27c13460d1d6c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/618cf0b3507845909bb27c13460d1d6c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/618cf0b3507845909bb27c13460d1d6c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_618cf0b3507845909bb27c13460d1d6c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 17 03:16:53.652361 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Tenant: tempest-AttachVolumeNegativeTest-816799241 Oct 17 03:16:53.652361 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Tenant-Id: 618cf0b3507845909bb27c13460d1d6c Oct 17 03:16:53.652361 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-816799241 Oct 17 03:16:53.652361 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-User: tempest-AttachVolumeNegativeTest-816799241-project Oct 17 03:16:53.652361 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-User-Domain-Id: default Oct 17 03:16:53.652361 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-User-Domain-Name: Default Oct 17 03:16:53.652361 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-User-Id: 1c786544e8fb4e8e8c3a4990a0f36725 Oct 17 03:16:53.652361 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-User-Name: tempest-AttachVolumeNegativeTest-816799241-project Oct 17 03:16:53.652361 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Oct 17 03:16:53.652361 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: {"volumeAttachment": {"volumeId": "e95edcd0-aeeb-4b4d-a407-c6a32f39ef38"}} Oct 17 03:16:53.652361 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: method: > Oct 17 03:16:53.653252 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: exception: Invalid volume: volume e95edcd0-aeeb-4b4d-a407-c6a32f39ef38 is already attached to instances: d521fa69-4f04-4d79-8a81-22b2e4bafbae Oct 17 03:16:53.653252 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: action_args: {'server_id': 'd521fa69-4f04-4d79-8a81-22b2e4bafbae', 'body': {'volumeAttachment': {'volumeId': 'e95edcd0-aeeb-4b4d-a407-c6a32f39ef38'}}} Oct 17 03:16:53.653252 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 03:16:53.653252 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:16:53.653252 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 17 03:16:53.653252 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 17 03:16:53.653252 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 17 03:16:53.653252 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 17 03:16:53.653252 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 17 03:16:53.653252 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 17 03:16:53.653252 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 17 03:16:53.653252 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 17 03:16:53.653252 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 17 03:16:53.653252 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 17 03:16:53.653252 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume e95edcd0-aeeb-4b4d-a407-c6a32f39ef38 is already attached to instances: d521fa69-4f04-4d79-8a81-22b2e4bafbae Oct 17 03:16:53.653252 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Oct 17 03:16:53.653252 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:16:53.653252 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Oct 17 03:16:53.653252 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:16:53.654581 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:16:53.654581 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:16:53.654581 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 03:16:53.654581 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 03:16:53.654581 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 03:16:53.654581 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 03:16:53.654581 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 03:16:53.654581 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 03:16:53.654581 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 03:16:53.654581 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 03:16:53.654581 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 03:16:53.654581 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 03:16:53.654581 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 17 03:16:53.654581 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 17 03:16:53.654581 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume e95edcd0-aeeb-4b4d-a407-c6a32f39ef38 is already attached to instances: d521fa69-4f04-4d79-8a81-22b2e4bafbae Oct 17 03:16:53.654581 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Oct 17 03:16:53.654581 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:16:53.654581 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Oct 17 03:16:53.654581 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:16:53.654581 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:16:53.656070 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:16:53.656070 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 03:16:53.656070 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 03:16:53.656070 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume e95edcd0-aeeb-4b4d-a407-c6a32f39ef38 is already attached to instances: d521fa69-4f04-4d79-8a81-22b2e4bafbae Oct 17 03:16:53.656070 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Oct 17 03:16:53.656070 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-b68a7c85-e970-4d80-9846-8cd73df7deaa tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Returning 400 to user: Invalid volume: volume e95edcd0-aeeb-4b4d-a407-c6a32f39ef38 is already attached to instances: d521fa69-4f04-4d79-8a81-22b2e4bafbae {{(pid=118886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 03:16:53.656070 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-b68a7c85-e970-4d80-9846-8cd73df7deaa tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] 10.222.0.27 "POST /compute/v2.1/servers/d521fa69-4f04-4d79-8a81-22b2e4bafbae/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.099453 Oct 17 03:16:53.656070 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 362/689] 10.222.0.27 () {60 vars in 1323 bytes} [Mon Oct 17 03:16:53 2022] POST /compute/v2.1/servers/d521fa69-4f04-4d79-8a81-22b2e4bafbae/os-volume_attachments => generated 174 bytes in 100 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 03:16:53.718771 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-cdf19a68-4cdf-4395-b594-3af9dca70809 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:16:53.719370 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-cdf19a68-4cdf-4395-b594-3af9dca70809 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] [instance: d521fa69-4f04-4d79-8a81-22b2e4bafbae] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:16:53.725899 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-cdf19a68-4cdf-4395-b594-3af9dca70809 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:53.726374 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-cdf19a68-4cdf-4395-b594-3af9dca70809 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:53.726803 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-cdf19a68-4cdf-4395-b594-3af9dca70809 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:53.727583 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-cdf19a68-4cdf-4395-b594-3af9dca70809 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:53.728037 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-cdf19a68-4cdf-4395-b594-3af9dca70809 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:53.728455 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-cdf19a68-4cdf-4395-b594-3af9dca70809 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:53.806528 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.objects.instance [None req-cdf19a68-4cdf-4395-b594-3af9dca70809 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lazy-loading 'services' on Instance uuid d521fa69-4f04-4d79-8a81-22b2e4bafbae {{(pid=118887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 03:16:53.878834 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-cdf19a68-4cdf-4395-b594-3af9dca70809 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] 10.222.0.27 "DELETE /compute/v2.1/servers/d521fa69-4f04-4d79-8a81-22b2e4bafbae/os-volume_attachments/e95edcd0-aeeb-4b4d-a407-c6a32f39ef38" status: 202 len: 0 microversion: 2.1 time: 0.164067 Oct 17 03:16:53.879456 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 328/690] 10.222.0.27 () {58 vars in 1416 bytes} [Mon Oct 17 03:16:53 2022] DELETE /compute/v2.1/servers/d521fa69-4f04-4d79-8a81-22b2e4bafbae/os-volume_attachments/e95edcd0-aeeb-4b4d-a407-c6a32f39ef38 => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 03:16:53.888770 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-46b2b01a-d6aa-4b8f-ae14-4e9d6dda427d tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:16:53.890958 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-46b2b01a-d6aa-4b8f-ae14-4e9d6dda427d tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] [instance: d521fa69-4f04-4d79-8a81-22b2e4bafbae] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:16:53.896935 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-46b2b01a-d6aa-4b8f-ae14-4e9d6dda427d tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:53.897417 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-46b2b01a-d6aa-4b8f-ae14-4e9d6dda427d tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:53.897853 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-46b2b01a-d6aa-4b8f-ae14-4e9d6dda427d tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:53.898584 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-46b2b01a-d6aa-4b8f-ae14-4e9d6dda427d tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:53.899085 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-46b2b01a-d6aa-4b8f-ae14-4e9d6dda427d tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:53.899577 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-46b2b01a-d6aa-4b8f-ae14-4e9d6dda427d tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:53.932641 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-46b2b01a-d6aa-4b8f-ae14-4e9d6dda427d tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] 10.222.0.27 "GET /compute/v2.1/servers/d521fa69-4f04-4d79-8a81-22b2e4bafbae/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047642 Oct 17 03:16:53.933200 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 363/691] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 17 03:16:53 2022] GET /compute/v2.1/servers/d521fa69-4f04-4d79-8a81-22b2e4bafbae/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:16:54.946996 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-1dadc2a9-e144-4b87-a932-80485e9f513c tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:16:54.949256 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-1dadc2a9-e144-4b87-a932-80485e9f513c tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] [instance: d521fa69-4f04-4d79-8a81-22b2e4bafbae] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:16:54.955421 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-1dadc2a9-e144-4b87-a932-80485e9f513c tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:54.955897 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-1dadc2a9-e144-4b87-a932-80485e9f513c tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:54.956321 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-1dadc2a9-e144-4b87-a932-80485e9f513c tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:54.956994 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-1dadc2a9-e144-4b87-a932-80485e9f513c tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:54.957437 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-1dadc2a9-e144-4b87-a932-80485e9f513c tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:54.957852 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-1dadc2a9-e144-4b87-a932-80485e9f513c tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:54.988325 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-1dadc2a9-e144-4b87-a932-80485e9f513c tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] 10.222.0.27 "GET /compute/v2.1/servers/d521fa69-4f04-4d79-8a81-22b2e4bafbae/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046658 Oct 17 03:16:54.988873 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 329/692] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 17 03:16:54 2022] GET /compute/v2.1/servers/d521fa69-4f04-4d79-8a81-22b2e4bafbae/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 03:16:55.052612 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-165d0793-3a79-401f-ae01-ae7353da24b5 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:16:55.053142 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-165d0793-3a79-401f-ae01-ae7353da24b5 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] [instance: d521fa69-4f04-4d79-8a81-22b2e4bafbae] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:16:55.059786 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-165d0793-3a79-401f-ae01-ae7353da24b5 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:55.060251 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-165d0793-3a79-401f-ae01-ae7353da24b5 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:55.060679 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-165d0793-3a79-401f-ae01-ae7353da24b5 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:55.061358 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-165d0793-3a79-401f-ae01-ae7353da24b5 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:55.061801 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-165d0793-3a79-401f-ae01-ae7353da24b5 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:55.062218 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-165d0793-3a79-401f-ae01-ae7353da24b5 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:55.087911 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-165d0793-3a79-401f-ae01-ae7353da24b5 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] [instance: d521fa69-4f04-4d79-8a81-22b2e4bafbae] Going to try to terminate instance {{(pid=118886) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 03:16:55.169482 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-165d0793-3a79-401f-ae01-ae7353da24b5 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] 10.222.0.27 "DELETE /compute/v2.1/servers/d521fa69-4f04-4d79-8a81-22b2e4bafbae" status: 204 len: 0 microversion: 2.1 time: 0.120336 Oct 17 03:16:55.170225 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 364/693] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 03:16:55 2022] DELETE /compute/v2.1/servers/d521fa69-4f04-4d79-8a81-22b2e4bafbae => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 03:16:55.178923 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-aecb4bcc-fa5a-47f2-a594-e73643306101 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:16:55.179602 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-aecb4bcc-fa5a-47f2-a594-e73643306101 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] [instance: d521fa69-4f04-4d79-8a81-22b2e4bafbae] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:16:55.186467 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-aecb4bcc-fa5a-47f2-a594-e73643306101 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:55.187036 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-aecb4bcc-fa5a-47f2-a594-e73643306101 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:55.187524 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-aecb4bcc-fa5a-47f2-a594-e73643306101 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:55.188284 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-aecb4bcc-fa5a-47f2-a594-e73643306101 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:55.188776 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-aecb4bcc-fa5a-47f2-a594-e73643306101 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:55.189207 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-aecb4bcc-fa5a-47f2-a594-e73643306101 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:55.328615 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-aecb4bcc-fa5a-47f2-a594-e73643306101 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c786544e8fb4e8e8c3a4990a0f36725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618cf0b3507845909bb27c13460d1d6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:16:55.336619 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-aecb4bcc-fa5a-47f2-a594-e73643306101 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] 10.222.0.27 "GET /compute/v2.1/servers/d521fa69-4f04-4d79-8a81-22b2e4bafbae" status: 200 len: 1679 microversion: 2.1 time: 0.161713 Oct 17 03:16:55.337283 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 330/694] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:16:55 2022] GET /compute/v2.1/servers/d521fa69-4f04-4d79-8a81-22b2e4bafbae => generated 1679 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:16:56.360915 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-1b036d65-d4ff-454f-aa72-ef7ff0e92c9a tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:16:56.361603 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-1b036d65-d4ff-454f-aa72-ef7ff0e92c9a tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] [instance: d521fa69-4f04-4d79-8a81-22b2e4bafbae] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:16:56.363980 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG dbcounter [-] [118886] Writing DB stats nova_api:SELECT=67,nova_api:DELETE=1,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=118886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:16:56.370488 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-1b036d65-d4ff-454f-aa72-ef7ff0e92c9a tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:56.370997 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-1b036d65-d4ff-454f-aa72-ef7ff0e92c9a tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:56.371430 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-1b036d65-d4ff-454f-aa72-ef7ff0e92c9a tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:56.372124 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-1b036d65-d4ff-454f-aa72-ef7ff0e92c9a tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:56.372574 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-1b036d65-d4ff-454f-aa72-ef7ff0e92c9a tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:56.372995 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-1b036d65-d4ff-454f-aa72-ef7ff0e92c9a tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:56.502407 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-1b036d65-d4ff-454f-aa72-ef7ff0e92c9a tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c786544e8fb4e8e8c3a4990a0f36725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618cf0b3507845909bb27c13460d1d6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:16:56.510669 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-1b036d65-d4ff-454f-aa72-ef7ff0e92c9a tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] 10.222.0.27 "GET /compute/v2.1/servers/d521fa69-4f04-4d79-8a81-22b2e4bafbae" status: 200 len: 1679 microversion: 2.1 time: 0.153999 Oct 17 03:16:56.511263 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 365/695] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:16:56 2022] GET /compute/v2.1/servers/d521fa69-4f04-4d79-8a81-22b2e4bafbae => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:16:56.814117 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-273f7574-157a-4acf-a4bc-52f735c77ffc tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:16:56.814591 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-273f7574-157a-4acf-a4bc-52f735c77ffc tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 78c535d2-a4ae-43ff-bf93-8c35dfb79876] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:16:56.816684 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG dbcounter [-] [118887] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=118887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:16:56.822779 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-273f7574-157a-4acf-a4bc-52f735c77ffc tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:56.823289 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-273f7574-157a-4acf-a4bc-52f735c77ffc tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:56.823718 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-273f7574-157a-4acf-a4bc-52f735c77ffc tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:56.824431 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-273f7574-157a-4acf-a4bc-52f735c77ffc tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:56.824912 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-273f7574-157a-4acf-a4bc-52f735c77ffc tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:56.825328 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-273f7574-157a-4acf-a4bc-52f735c77ffc tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:56.849146 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-273f7574-157a-4acf-a4bc-52f735c77ffc tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "GET /compute/v2.1/servers/78c535d2-a4ae-43ff-bf93-8c35dfb79876/ips" status: 200 len: 151 microversion: 2.20 time: 0.092667 Oct 17 03:16:56.849697 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 331/696] 10.222.0.27 () {60 vars in 1289 bytes} [Mon Oct 17 03:16:56 2022] GET /compute/v2.1/servers/78c535d2-a4ae-43ff-bf93-8c35dfb79876/ips => generated 151 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 03:16:57.534178 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-c5b49757-78b7-4b0d-a792-43e22c195d87 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:16:57.534933 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-c5b49757-78b7-4b0d-a792-43e22c195d87 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] [instance: d521fa69-4f04-4d79-8a81-22b2e4bafbae] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:16:57.542042 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-c5b49757-78b7-4b0d-a792-43e22c195d87 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:57.542590 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-c5b49757-78b7-4b0d-a792-43e22c195d87 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:57.543153 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-c5b49757-78b7-4b0d-a792-43e22c195d87 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:57.543905 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-c5b49757-78b7-4b0d-a792-43e22c195d87 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:57.544439 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-c5b49757-78b7-4b0d-a792-43e22c195d87 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:57.544861 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-c5b49757-78b7-4b0d-a792-43e22c195d87 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:57.610658 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-c5b49757-78b7-4b0d-a792-43e22c195d87 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c786544e8fb4e8e8c3a4990a0f36725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618cf0b3507845909bb27c13460d1d6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:16:57.619759 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-c5b49757-78b7-4b0d-a792-43e22c195d87 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] 10.222.0.27 "GET /compute/v2.1/servers/d521fa69-4f04-4d79-8a81-22b2e4bafbae" status: 200 len: 1613 microversion: 2.1 time: 0.089670 Oct 17 03:16:57.620558 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 366/697] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:16:57 2022] GET /compute/v2.1/servers/d521fa69-4f04-4d79-8a81-22b2e4bafbae => generated 1613 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:16:57.732905 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [req-82c488a5-450a-4855-9f68-64e8b5205f30 req-cf6b811d-dbed-4572-9702-9817921fdbe5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d521fa69-4f04-4d79-8a81-22b2e4bafbae", "name": "network-vif-deleted", "tag": "3057284f-cd50-4b2a-8fd1-40b4a9779789"}]} {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:16:57.745529 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [req-82c488a5-450a-4855-9f68-64e8b5205f30 req-cf6b811d-dbed-4572-9702-9817921fdbe5 service nova] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:57.746093 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [req-82c488a5-450a-4855-9f68-64e8b5205f30 req-cf6b811d-dbed-4572-9702-9817921fdbe5 service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:57.746754 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [req-82c488a5-450a-4855-9f68-64e8b5205f30 req-cf6b811d-dbed-4572-9702-9817921fdbe5 service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:57.762721 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.compute.server_external_events [req-82c488a5-450a-4855-9f68-64e8b5205f30 req-cf6b811d-dbed-4572-9702-9817921fdbe5 service nova] Creating event network-vif-deleted:3057284f-cd50-4b2a-8fd1-40b4a9779789 for instance d521fa69-4f04-4d79-8a81-22b2e4bafbae on hv-cinder-84697 Oct 17 03:16:57.768047 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [req-82c488a5-450a-4855-9f68-64e8b5205f30 req-cf6b811d-dbed-4572-9702-9817921fdbe5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039509 Oct 17 03:16:57.768650 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 332/698] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 03:16:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:16:58.643962 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-9f2bfe81-6289-4c62-bc1f-a75f506c4a55 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:16:58.644594 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-9f2bfe81-6289-4c62-bc1f-a75f506c4a55 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] [instance: d521fa69-4f04-4d79-8a81-22b2e4bafbae] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:16:58.652167 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-9f2bfe81-6289-4c62-bc1f-a75f506c4a55 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:58.652649 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-9f2bfe81-6289-4c62-bc1f-a75f506c4a55 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:58.653311 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-9f2bfe81-6289-4c62-bc1f-a75f506c4a55 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:58.653756 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-9f2bfe81-6289-4c62-bc1f-a75f506c4a55 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:58.654201 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-9f2bfe81-6289-4c62-bc1f-a75f506c4a55 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:58.654617 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-9f2bfe81-6289-4c62-bc1f-a75f506c4a55 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:58.668925 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.wsgi [None req-9f2bfe81-6289-4c62-bc1f-a75f506c4a55 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] HTTP exception thrown: Instance d521fa69-4f04-4d79-8a81-22b2e4bafbae could not be found. Oct 17 03:16:58.670581 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-9f2bfe81-6289-4c62-bc1f-a75f506c4a55 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Request method failure captured: Oct 17 03:16:58.670581 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: request: GET /compute/v2.1/servers/d521fa69-4f04-4d79-8a81-22b2e4bafbae HTTP/1.1 Oct 17 03:16:58.670581 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Accept: application/json Oct 17 03:16:58.670581 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Accept-Encoding: identity Oct 17 03:16:58.670581 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Connection: close Oct 17 03:16:58.670581 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Content-Length: 0 Oct 17 03:16:58.670581 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Content-Type: application/json Oct 17 03:16:58.670581 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Host: 10.222.0.27 Oct 17 03:16:58.670581 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Openstack-System-Scope: None Oct 17 03:16:58.670581 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: User-Agent: python-urllib3/1.26.12 Oct 17 03:16:58.670581 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Auth-Token: gAAAAABjTMf-SpDw6REUqxlSOIvhtlgFxCyi7gugHXw9249WtXgpgYG8a0yyM9JbvLErgztKU1aaT378mlFtg9Uhrjdru2uD9-W4FJ-CkFLSVPWuyDvIf6q3m3rDvz5qZHkGg2K6V9p96rkOt2BGqAhrNrGmStKoZpndwIVbln6Rg2eRSFSEBDA Oct 17 03:16:58.670581 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Domain-Id: None Oct 17 03:16:58.670581 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Domain-Name: None Oct 17 03:16:58.670581 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Identity-Status: Confirmed Oct 17 03:16:58.670581 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Is-Admin-Project: True Oct 17 03:16:58.670581 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Project-Domain-Id: default Oct 17 03:16:58.670581 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Project-Domain-Name: Default Oct 17 03:16:58.670581 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Project-Id: 618cf0b3507845909bb27c13460d1d6c Oct 17 03:16:58.670581 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Project-Name: tempest-AttachVolumeNegativeTest-816799241 Oct 17 03:16:58.670581 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Role: member,reader Oct 17 03:16:58.670581 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Roles: member,reader Oct 17 03:16:58.672296 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/618cf0b3507845909bb27c13460d1d6c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/618cf0b3507845909bb27c13460d1d6c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/618cf0b3507845909bb27c13460d1d6c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_618cf0b3507845909bb27c13460d1d6c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 17 03:16:58.672296 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Tenant: tempest-AttachVolumeNegativeTest-816799241 Oct 17 03:16:58.672296 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Tenant-Id: 618cf0b3507845909bb27c13460d1d6c Oct 17 03:16:58.672296 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-816799241 Oct 17 03:16:58.672296 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-User: tempest-AttachVolumeNegativeTest-816799241-project Oct 17 03:16:58.672296 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-User-Domain-Id: default Oct 17 03:16:58.672296 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-User-Domain-Name: Default Oct 17 03:16:58.672296 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-User-Id: 1c786544e8fb4e8e8c3a4990a0f36725 Oct 17 03:16:58.672296 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-User-Name: tempest-AttachVolumeNegativeTest-816799241-project Oct 17 03:16:58.672296 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: method: > Oct 17 03:16:58.672296 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: exception: Instance d521fa69-4f04-4d79-8a81-22b2e4bafbae could not be found. Oct 17 03:16:58.672296 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: action_args: {'id': 'd521fa69-4f04-4d79-8a81-22b2e4bafbae'} Oct 17 03:16:58.673082 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 03:16:58.673082 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:16:58.673082 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 03:16:58.673082 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 03:16:58.673082 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 03:16:58.673082 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 03:16:58.673082 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 03:16:58.673082 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 03:16:58.673082 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 03:16:58.673082 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 03:16:58.673082 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d521fa69-4f04-4d79-8a81-22b2e4bafbae could not be found. Oct 17 03:16:58.673082 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Oct 17 03:16:58.673082 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:16:58.673082 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Oct 17 03:16:58.673082 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:16:58.673082 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:16:58.673082 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:16:58.673082 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 03:16:58.673082 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 03:16:58.673082 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 03:16:58.674305 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 03:16:58.674305 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 03:16:58.674305 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 03:16:58.674305 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 03:16:58.674305 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 03:16:58.674305 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 03:16:58.674305 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 03:16:58.674305 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d521fa69-4f04-4d79-8a81-22b2e4bafbae could not be found. Oct 17 03:16:58.674305 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Oct 17 03:16:58.674305 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:16:58.674305 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Oct 17 03:16:58.674305 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:16:58.674305 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:16:58.674305 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:16:58.674305 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 03:16:58.674305 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 03:16:58.674305 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d521fa69-4f04-4d79-8a81-22b2e4bafbae could not be found. Oct 17 03:16:58.674305 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Oct 17 03:16:58.675444 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-9f2bfe81-6289-4c62-bc1f-a75f506c4a55 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Returning 404 to user: Instance d521fa69-4f04-4d79-8a81-22b2e4bafbae could not be found. {{(pid=118886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 03:16:58.675444 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-9f2bfe81-6289-4c62-bc1f-a75f506c4a55 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] 10.222.0.27 "GET /compute/v2.1/servers/d521fa69-4f04-4d79-8a81-22b2e4bafbae" status: 404 len: 111 microversion: 2.1 time: 0.031938 Oct 17 03:16:58.675444 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 367/699] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:16:58 2022] GET /compute/v2.1/servers/d521fa69-4f04-4d79-8a81-22b2e4bafbae => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 03:16:58.682281 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-68fff2b1-5377-42bc-a8bb-e50cc49c6dd7 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Calling method '.version_select at 0x7fc7017078b0>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:16:58.701164 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-68fff2b1-5377-42bc-a8bb-e50cc49c6dd7 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-795925854" status: 202 len: 0 microversion: 2.1 time: 0.023563 Oct 17 03:16:58.702020 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 333/700] 10.222.0.27 () {58 vars in 1218 bytes} [Mon Oct 17 03:16:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-795925854 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 03:16:59.274686 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-d2070f73-53c7-4d0b-be87-652371a83f61 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Action: 'create', calling method: .version_select at 0x7fc7017ceca0>, body: {"keypair": {"name": "tempest-keypair-208486779", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNZDwcvQAjbOzqCjwa6g07p5y4K9YF8NjPN4hWnwoDrZV2ChoZg34seom4EMLLVLU+DDmqKhA22JDSYRqXhSHWOKQRNyzYZRwKwR224Hp5TYvI1ezzG4WleuP31OZ1k1rQ=="}} {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:16:59.291375 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.quota [None req-d2070f73-53c7-4d0b-be87-652371a83f61 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Getting quotas for project 618cf0b3507845909bb27c13460d1d6c. Resources: {'key_pairs'} {{(pid=118886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 03:16:59.295261 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.quota [None req-d2070f73-53c7-4d0b-be87-652371a83f61 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Getting quotas for user 1c786544e8fb4e8e8c3a4990a0f36725 and project 618cf0b3507845909bb27c13460d1d6c. Resources: {'key_pairs'} {{(pid=118886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 03:16:59.316675 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-d2070f73-53c7-4d0b-be87-652371a83f61 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.046080 Oct 17 03:16:59.317256 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 368/701] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 17 03:16:59 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:16:59.483536 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-813eb938-abf4-4766-98c6-b436af600ab3 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:16:59.484411 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-813eb938-abf4-4766-98c6-b436af600ab3 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 78c535d2-a4ae-43ff-bf93-8c35dfb79876] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:16:59.491512 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-813eb938-abf4-4766-98c6-b436af600ab3 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:59.492022 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-813eb938-abf4-4766-98c6-b436af600ab3 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:59.492409 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-813eb938-abf4-4766-98c6-b436af600ab3 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:59.493656 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-813eb938-abf4-4766-98c6-b436af600ab3 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:59.494172 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-813eb938-abf4-4766-98c6-b436af600ab3 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:59.494506 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-813eb938-abf4-4766-98c6-b436af600ab3 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:59.517483 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.objects.instance [None req-813eb938-abf4-4766-98c6-b436af600ab3 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lazy-loading 'flavor' on Instance uuid 78c535d2-a4ae-43ff-bf93-8c35dfb79876 {{(pid=118887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 03:16:59.579852 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG dbcounter [-] [118887] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=118887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:16:59.721247 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-813eb938-abf4-4766-98c6-b436af600ab3 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "POST /compute/v2.1/servers/78c535d2-a4ae-43ff-bf93-8c35dfb79876/action" status: 202 len: 0 microversion: 2.20 time: 0.241951 Oct 17 03:16:59.722112 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 334/702] 10.222.0.27 () {62 vars in 1319 bytes} [Mon Oct 17 03:16:59 2022] POST /compute/v2.1/servers/78c535d2-a4ae-43ff-bf93-8c35dfb79876/action => generated 0 bytes in 244 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 17 03:16:59.731468 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-5e2858ff-3074-4fd5-8dbe-d6b5174e0398 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:16:59.732797 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-5e2858ff-3074-4fd5-8dbe-d6b5174e0398 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 78c535d2-a4ae-43ff-bf93-8c35dfb79876] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:16:59.742200 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-5e2858ff-3074-4fd5-8dbe-d6b5174e0398 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:59.742779 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-5e2858ff-3074-4fd5-8dbe-d6b5174e0398 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:59.743191 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-5e2858ff-3074-4fd5-8dbe-d6b5174e0398 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:16:59.744606 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-5e2858ff-3074-4fd5-8dbe-d6b5174e0398 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:16:59.745187 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-5e2858ff-3074-4fd5-8dbe-d6b5174e0398 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:16:59.745611 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-5e2858ff-3074-4fd5-8dbe-d6b5174e0398 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:00.087469 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-5e2858ff-3074-4fd5-8dbe-d6b5174e0398 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:17:00.095567 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-5e2858ff-3074-4fd5-8dbe-d6b5174e0398 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:17:00.097033 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-5e2858ff-3074-4fd5-8dbe-d6b5174e0398 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:17:00.098174 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-5e2858ff-3074-4fd5-8dbe-d6b5174e0398 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "GET /compute/v2.1/servers/78c535d2-a4ae-43ff-bf93-8c35dfb79876" status: 200 len: 1722 microversion: 2.20 time: 0.371843 Oct 17 03:17:00.098713 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 369/703] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 03:16:59 2022] GET /compute/v2.1/servers/78c535d2-a4ae-43ff-bf93-8c35dfb79876 => generated 1722 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:17:00.613174 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-97c06a1e-db6d-4d0c-af14-1604b626e4f3 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-412869531", "imageRef": "e6d41914-f1bc-4b72-9113-1a69b3d0d83b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5bef7eaf-4926-430d-bb2f-ad10a16554bf"}], "security_groups": [{"name": "tempest-securitygroup--28581973"}], "key_name": "tempest-keypair-208486779", "user_data": "}} {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:17:00.714246 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.network.neutron [None req-97c06a1e-db6d-4d0c-af14-1604b626e4f3 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] validate_networks() for [('5bef7eaf-4926-430d-bb2f-ad10a16554bf', None, None, None, None, None)] {{(pid=118887) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 03:17:01.116789 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.virt.hardware [None req-97c06a1e-db6d-4d0c-af14-1604b626e4f3 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Flavor limits 0:0:0 {{(pid=118887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 03:17:01.117379 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.virt.hardware [None req-97c06a1e-db6d-4d0c-af14-1604b626e4f3 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Image limits 0:0:0 {{(pid=118887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 03:17:01.117717 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.virt.hardware [None req-97c06a1e-db6d-4d0c-af14-1604b626e4f3 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Flavor pref 0:0:0 {{(pid=118887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 03:17:01.118895 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.virt.hardware [None req-97c06a1e-db6d-4d0c-af14-1604b626e4f3 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Image pref 0:0:0 {{(pid=118887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 03:17:01.119360 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.virt.hardware [None req-97c06a1e-db6d-4d0c-af14-1604b626e4f3 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 03:17:01.124096 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-17022fae-4e3e-43cd-854a-e3392f3a75da tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:17:01.124694 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-17022fae-4e3e-43cd-854a-e3392f3a75da tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 78c535d2-a4ae-43ff-bf93-8c35dfb79876] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:17:01.128188 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-97c06a1e-db6d-4d0c-af14-1604b626e4f3 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:01.128689 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-97c06a1e-db6d-4d0c-af14-1604b626e4f3 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:01.129114 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-97c06a1e-db6d-4d0c-af14-1604b626e4f3 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:01.129824 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-97c06a1e-db6d-4d0c-af14-1604b626e4f3 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:01.130268 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-97c06a1e-db6d-4d0c-af14-1604b626e4f3 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:01.130682 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-97c06a1e-db6d-4d0c-af14-1604b626e4f3 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:01.131202 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-17022fae-4e3e-43cd-854a-e3392f3a75da tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:01.131650 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-17022fae-4e3e-43cd-854a-e3392f3a75da tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:01.132077 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-17022fae-4e3e-43cd-854a-e3392f3a75da tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:01.132757 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-17022fae-4e3e-43cd-854a-e3392f3a75da tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:01.133827 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-17022fae-4e3e-43cd-854a-e3392f3a75da tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:01.133827 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-17022fae-4e3e-43cd-854a-e3392f3a75da tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:01.148895 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.quota [None req-97c06a1e-db6d-4d0c-af14-1604b626e4f3 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Getting quotas for project 618cf0b3507845909bb27c13460d1d6c. Resources: {'instances', 'cores', 'ram'} {{(pid=118887) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 03:17:01.154674 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.quota [None req-97c06a1e-db6d-4d0c-af14-1604b626e4f3 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Getting quotas for user 1c786544e8fb4e8e8c3a4990a0f36725 and project 618cf0b3507845909bb27c13460d1d6c. Resources: {'instances', 'cores', 'ram'} {{(pid=118887) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 03:17:01.168221 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-97c06a1e-db6d-4d0c-af14-1604b626e4f3 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Going to run 1 instances... {{(pid=118887) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 03:17:01.170711 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-97c06a1e-db6d-4d0c-af14-1604b626e4f3 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] [instance: 87c4c474-a5ab-4532-bffa-5b3d2cb15d55] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e6d41914-f1bc-4b72-9113-1a69b3d0d83b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118887) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 03:17:01.221300 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-97c06a1e-db6d-4d0c-af14-1604b626e4f3 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.612525 Oct 17 03:17:01.222035 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 335/704] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 03:17:00 2022] POST /compute/v2.1/servers => generated 400 bytes in 614 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 03:17:01.233607 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-e1bb0d80-1120-4df7-bd6a-40092426bd51 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:17:01.234213 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-e1bb0d80-1120-4df7-bd6a-40092426bd51 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] [instance: 87c4c474-a5ab-4532-bffa-5b3d2cb15d55] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:17:01.285944 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-17022fae-4e3e-43cd-854a-e3392f3a75da tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:17:01.288717 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-e1bb0d80-1120-4df7-bd6a-40092426bd51 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c786544e8fb4e8e8c3a4990a0f36725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618cf0b3507845909bb27c13460d1d6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:17:01.295579 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-17022fae-4e3e-43cd-854a-e3392f3a75da tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:17:01.296443 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-e1bb0d80-1120-4df7-bd6a-40092426bd51 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] 10.222.0.27 "GET /compute/v2.1/servers/87c4c474-a5ab-4532-bffa-5b3d2cb15d55" status: 200 len: 1240 microversion: 2.1 time: 0.066577 Oct 17 03:17:01.297014 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 336/705] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:17:01 2022] GET /compute/v2.1/servers/87c4c474-a5ab-4532-bffa-5b3d2cb15d55 => generated 1240 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:17:01.299707 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-17022fae-4e3e-43cd-854a-e3392f3a75da tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:17:01.300926 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-17022fae-4e3e-43cd-854a-e3392f3a75da tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "GET /compute/v2.1/servers/78c535d2-a4ae-43ff-bf93-8c35dfb79876" status: 200 len: 1722 microversion: 2.20 time: 0.180628 Oct 17 03:17:01.301475 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 370/706] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 03:17:01 2022] GET /compute/v2.1/servers/78c535d2-a4ae-43ff-bf93-8c35dfb79876 => generated 1722 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:17:02.319671 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-7f8aff18-25e3-4730-b3c9-b282883e76c5 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:17:02.320369 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-7f8aff18-25e3-4730-b3c9-b282883e76c5 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] [instance: 87c4c474-a5ab-4532-bffa-5b3d2cb15d55] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:17:02.326954 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-3de566db-0511-4cf2-977b-f13dd280887d tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:17:02.327575 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-3de566db-0511-4cf2-977b-f13dd280887d tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 78c535d2-a4ae-43ff-bf93-8c35dfb79876] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:17:02.327731 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-7f8aff18-25e3-4730-b3c9-b282883e76c5 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:02.328238 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-7f8aff18-25e3-4730-b3c9-b282883e76c5 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:02.328738 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-7f8aff18-25e3-4730-b3c9-b282883e76c5 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:02.329498 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-7f8aff18-25e3-4730-b3c9-b282883e76c5 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:02.330109 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-7f8aff18-25e3-4730-b3c9-b282883e76c5 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:02.330801 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-7f8aff18-25e3-4730-b3c9-b282883e76c5 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:02.334157 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-3de566db-0511-4cf2-977b-f13dd280887d tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:02.334637 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-3de566db-0511-4cf2-977b-f13dd280887d tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:02.335097 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-3de566db-0511-4cf2-977b-f13dd280887d tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:02.335792 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-3de566db-0511-4cf2-977b-f13dd280887d tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:02.336398 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-3de566db-0511-4cf2-977b-f13dd280887d tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:02.336916 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-3de566db-0511-4cf2-977b-f13dd280887d tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:02.410446 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-7f8aff18-25e3-4730-b3c9-b282883e76c5 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c786544e8fb4e8e8c3a4990a0f36725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618cf0b3507845909bb27c13460d1d6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:17:02.419902 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-7f8aff18-25e3-4730-b3c9-b282883e76c5 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] 10.222.0.27 "GET /compute/v2.1/servers/87c4c474-a5ab-4532-bffa-5b3d2cb15d55" status: 200 len: 1292 microversion: 2.1 time: 0.103951 Oct 17 03:17:02.437481 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 337/707] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:17:02 2022] GET /compute/v2.1/servers/87c4c474-a5ab-4532-bffa-5b3d2cb15d55 => generated 1292 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:17:02.494951 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-3de566db-0511-4cf2-977b-f13dd280887d tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:17:02.505430 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-3de566db-0511-4cf2-977b-f13dd280887d tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:17:02.507357 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-3de566db-0511-4cf2-977b-f13dd280887d tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:17:02.509119 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-3de566db-0511-4cf2-977b-f13dd280887d tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "GET /compute/v2.1/servers/78c535d2-a4ae-43ff-bf93-8c35dfb79876" status: 200 len: 1722 microversion: 2.20 time: 0.186621 Oct 17 03:17:02.515244 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 371/708] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 03:17:02 2022] GET /compute/v2.1/servers/78c535d2-a4ae-43ff-bf93-8c35dfb79876 => generated 1722 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 03:17:03.444503 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-ad9c9c9e-b07a-4f47-b898-b3345c49e02a tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:17:03.445144 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-ad9c9c9e-b07a-4f47-b898-b3345c49e02a tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] [instance: 87c4c474-a5ab-4532-bffa-5b3d2cb15d55] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:17:03.451710 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-ad9c9c9e-b07a-4f47-b898-b3345c49e02a tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:03.452294 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-ad9c9c9e-b07a-4f47-b898-b3345c49e02a tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:03.452805 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-ad9c9c9e-b07a-4f47-b898-b3345c49e02a tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:03.453512 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-ad9c9c9e-b07a-4f47-b898-b3345c49e02a tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:03.453967 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-ad9c9c9e-b07a-4f47-b898-b3345c49e02a tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:03.454391 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-ad9c9c9e-b07a-4f47-b898-b3345c49e02a tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:03.535572 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-30aa7864-044a-4f63-978d-6a15fd22675b tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:17:03.536276 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-30aa7864-044a-4f63-978d-6a15fd22675b tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 78c535d2-a4ae-43ff-bf93-8c35dfb79876] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:17:03.543466 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-30aa7864-044a-4f63-978d-6a15fd22675b tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:03.544039 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-30aa7864-044a-4f63-978d-6a15fd22675b tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:03.544538 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-30aa7864-044a-4f63-978d-6a15fd22675b tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:03.545237 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-30aa7864-044a-4f63-978d-6a15fd22675b tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:03.545683 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-30aa7864-044a-4f63-978d-6a15fd22675b tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:03.546103 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-30aa7864-044a-4f63-978d-6a15fd22675b tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:03.643008 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-ad9c9c9e-b07a-4f47-b898-b3345c49e02a tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c786544e8fb4e8e8c3a4990a0f36725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618cf0b3507845909bb27c13460d1d6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:17:03.650968 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-ad9c9c9e-b07a-4f47-b898-b3345c49e02a tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] 10.222.0.27 "GET /compute/v2.1/servers/87c4c474-a5ab-4532-bffa-5b3d2cb15d55" status: 200 len: 1364 microversion: 2.1 time: 0.210447 Oct 17 03:17:03.667092 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 338/709] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:17:03 2022] GET /compute/v2.1/servers/87c4c474-a5ab-4532-bffa-5b3d2cb15d55 => generated 1364 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:17:03.678760 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-30aa7864-044a-4f63-978d-6a15fd22675b tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:17:03.683249 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG dbcounter [-] [118886] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:17:03.689325 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-30aa7864-044a-4f63-978d-6a15fd22675b tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:17:03.690766 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-30aa7864-044a-4f63-978d-6a15fd22675b tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:17:03.692154 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-30aa7864-044a-4f63-978d-6a15fd22675b tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "GET /compute/v2.1/servers/78c535d2-a4ae-43ff-bf93-8c35dfb79876" status: 200 len: 1722 microversion: 2.20 time: 0.160795 Oct 17 03:17:03.692714 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 372/710] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 03:17:03 2022] GET /compute/v2.1/servers/78c535d2-a4ae-43ff-bf93-8c35dfb79876 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 03:17:03.918672 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [req-cfb9604f-770b-4636-a09b-a205900f52d9 req-df134b60-68f8-4e04-bac7-57247cf4cd6a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87c4c474-a5ab-4532-bffa-5b3d2cb15d55", "tag": "5ea75a02-e55b-48e9-bc6b-8eb295df879e"}]} {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:17:03.928467 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [req-cfb9604f-770b-4636-a09b-a205900f52d9 req-df134b60-68f8-4e04-bac7-57247cf4cd6a service nova] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:03.928940 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [req-cfb9604f-770b-4636-a09b-a205900f52d9 req-df134b60-68f8-4e04-bac7-57247cf4cd6a service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:03.929363 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [req-cfb9604f-770b-4636-a09b-a205900f52d9 req-df134b60-68f8-4e04-bac7-57247cf4cd6a service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:03.941134 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.compute.server_external_events [req-cfb9604f-770b-4636-a09b-a205900f52d9 req-df134b60-68f8-4e04-bac7-57247cf4cd6a service nova] Creating event network-changed:5ea75a02-e55b-48e9-bc6b-8eb295df879e for instance 87c4c474-a5ab-4532-bffa-5b3d2cb15d55 on hv-cinder-84697 Oct 17 03:17:03.945771 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [req-cfb9604f-770b-4636-a09b-a205900f52d9 req-df134b60-68f8-4e04-bac7-57247cf4cd6a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031372 Oct 17 03:17:03.946611 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 339/711] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 03:17:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:17:04.674707 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-ecf88bf7-f664-4576-b7db-95a43e7ae818 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:17:04.675339 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-ecf88bf7-f664-4576-b7db-95a43e7ae818 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] [instance: 87c4c474-a5ab-4532-bffa-5b3d2cb15d55] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:17:04.683285 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-ecf88bf7-f664-4576-b7db-95a43e7ae818 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:04.683768 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-ecf88bf7-f664-4576-b7db-95a43e7ae818 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:04.684202 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-ecf88bf7-f664-4576-b7db-95a43e7ae818 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:04.684896 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-ecf88bf7-f664-4576-b7db-95a43e7ae818 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:04.685351 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-ecf88bf7-f664-4576-b7db-95a43e7ae818 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:04.685777 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-ecf88bf7-f664-4576-b7db-95a43e7ae818 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:04.718694 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-d6ebd292-59e4-4129-97cc-e5d64a55b5cf tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:17:04.719440 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-d6ebd292-59e4-4129-97cc-e5d64a55b5cf tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 78c535d2-a4ae-43ff-bf93-8c35dfb79876] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:17:04.725753 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-d6ebd292-59e4-4129-97cc-e5d64a55b5cf tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:04.726236 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-d6ebd292-59e4-4129-97cc-e5d64a55b5cf tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:04.726674 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-d6ebd292-59e4-4129-97cc-e5d64a55b5cf tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:04.728028 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-d6ebd292-59e4-4129-97cc-e5d64a55b5cf tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:04.728876 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-d6ebd292-59e4-4129-97cc-e5d64a55b5cf tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:04.729314 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-d6ebd292-59e4-4129-97cc-e5d64a55b5cf tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:04.817649 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-ecf88bf7-f664-4576-b7db-95a43e7ae818 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c786544e8fb4e8e8c3a4990a0f36725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618cf0b3507845909bb27c13460d1d6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:17:04.825790 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-ecf88bf7-f664-4576-b7db-95a43e7ae818 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] 10.222.0.27 "GET /compute/v2.1/servers/87c4c474-a5ab-4532-bffa-5b3d2cb15d55" status: 200 len: 1364 microversion: 2.1 time: 0.155421 Oct 17 03:17:04.826403 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 373/712] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:17:04 2022] GET /compute/v2.1/servers/87c4c474-a5ab-4532-bffa-5b3d2cb15d55 => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:17:04.864466 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-d6ebd292-59e4-4129-97cc-e5d64a55b5cf tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:17:04.873230 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-d6ebd292-59e4-4129-97cc-e5d64a55b5cf tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:17:04.874664 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-d6ebd292-59e4-4129-97cc-e5d64a55b5cf tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:17:04.875827 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-d6ebd292-59e4-4129-97cc-e5d64a55b5cf tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "GET /compute/v2.1/servers/78c535d2-a4ae-43ff-bf93-8c35dfb79876" status: 200 len: 1722 microversion: 2.20 time: 0.161957 Oct 17 03:17:04.876371 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 340/713] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 03:17:04 2022] GET /compute/v2.1/servers/78c535d2-a4ae-43ff-bf93-8c35dfb79876 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 03:17:05.848328 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-b664f570-8858-44e1-a2e6-30e3a3953c8d tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:17:05.849036 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-b664f570-8858-44e1-a2e6-30e3a3953c8d tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] [instance: 87c4c474-a5ab-4532-bffa-5b3d2cb15d55] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:17:05.855541 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-b664f570-8858-44e1-a2e6-30e3a3953c8d tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:05.856015 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-b664f570-8858-44e1-a2e6-30e3a3953c8d tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:05.856444 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-b664f570-8858-44e1-a2e6-30e3a3953c8d tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:05.857127 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-b664f570-8858-44e1-a2e6-30e3a3953c8d tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:05.857571 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-b664f570-8858-44e1-a2e6-30e3a3953c8d tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:05.857990 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-b664f570-8858-44e1-a2e6-30e3a3953c8d tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:05.900980 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-1c094f6c-cb5b-4709-bccc-5784f9a0e4b5 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:17:05.901632 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-1c094f6c-cb5b-4709-bccc-5784f9a0e4b5 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 78c535d2-a4ae-43ff-bf93-8c35dfb79876] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:17:05.909132 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-1c094f6c-cb5b-4709-bccc-5784f9a0e4b5 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:05.909700 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-1c094f6c-cb5b-4709-bccc-5784f9a0e4b5 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:05.910228 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-1c094f6c-cb5b-4709-bccc-5784f9a0e4b5 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:05.911048 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-1c094f6c-cb5b-4709-bccc-5784f9a0e4b5 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:05.911572 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-1c094f6c-cb5b-4709-bccc-5784f9a0e4b5 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:05.912184 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-1c094f6c-cb5b-4709-bccc-5784f9a0e4b5 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:05.991224 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-b664f570-8858-44e1-a2e6-30e3a3953c8d tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c786544e8fb4e8e8c3a4990a0f36725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618cf0b3507845909bb27c13460d1d6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:17:05.999460 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-b664f570-8858-44e1-a2e6-30e3a3953c8d tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] 10.222.0.27 "GET /compute/v2.1/servers/87c4c474-a5ab-4532-bffa-5b3d2cb15d55" status: 200 len: 1364 microversion: 2.1 time: 0.154942 Oct 17 03:17:06.000020 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 374/714] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:17:05 2022] GET /compute/v2.1/servers/87c4c474-a5ab-4532-bffa-5b3d2cb15d55 => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:17:06.094318 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-1c094f6c-cb5b-4709-bccc-5784f9a0e4b5 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:17:06.103081 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-1c094f6c-cb5b-4709-bccc-5784f9a0e4b5 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:17:06.104608 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-1c094f6c-cb5b-4709-bccc-5784f9a0e4b5 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:17:06.105765 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-1c094f6c-cb5b-4709-bccc-5784f9a0e4b5 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "GET /compute/v2.1/servers/78c535d2-a4ae-43ff-bf93-8c35dfb79876" status: 200 len: 1722 microversion: 2.20 time: 0.208808 Oct 17 03:17:06.106325 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 341/715] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 03:17:05 2022] GET /compute/v2.1/servers/78c535d2-a4ae-43ff-bf93-8c35dfb79876 => generated 1722 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 03:17:07.024888 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-08feb576-7ecb-446a-8673-de79791385a7 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:17:07.025513 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-08feb576-7ecb-446a-8673-de79791385a7 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] [instance: 87c4c474-a5ab-4532-bffa-5b3d2cb15d55] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:17:07.031894 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-08feb576-7ecb-446a-8673-de79791385a7 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:07.032369 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-08feb576-7ecb-446a-8673-de79791385a7 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:07.032798 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-08feb576-7ecb-446a-8673-de79791385a7 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:07.033485 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-08feb576-7ecb-446a-8673-de79791385a7 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:07.034183 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-08feb576-7ecb-446a-8673-de79791385a7 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:07.034599 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-08feb576-7ecb-446a-8673-de79791385a7 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:07.132749 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-e8413c83-4522-49ba-923a-6fa3a5bc9504 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:17:07.133440 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-e8413c83-4522-49ba-923a-6fa3a5bc9504 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 78c535d2-a4ae-43ff-bf93-8c35dfb79876] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:17:07.141291 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-e8413c83-4522-49ba-923a-6fa3a5bc9504 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:07.141777 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-e8413c83-4522-49ba-923a-6fa3a5bc9504 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:07.142206 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-e8413c83-4522-49ba-923a-6fa3a5bc9504 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:07.142923 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-e8413c83-4522-49ba-923a-6fa3a5bc9504 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:07.143382 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-e8413c83-4522-49ba-923a-6fa3a5bc9504 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:07.143802 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-e8413c83-4522-49ba-923a-6fa3a5bc9504 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:07.174190 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-08feb576-7ecb-446a-8673-de79791385a7 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c786544e8fb4e8e8c3a4990a0f36725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618cf0b3507845909bb27c13460d1d6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:17:07.182016 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-08feb576-7ecb-446a-8673-de79791385a7 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] 10.222.0.27 "GET /compute/v2.1/servers/87c4c474-a5ab-4532-bffa-5b3d2cb15d55" status: 200 len: 1364 microversion: 2.1 time: 0.161191 Oct 17 03:17:07.182665 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 375/716] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:17:07 2022] GET /compute/v2.1/servers/87c4c474-a5ab-4532-bffa-5b3d2cb15d55 => generated 1364 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:17:07.277804 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-e8413c83-4522-49ba-923a-6fa3a5bc9504 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:17:07.286684 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-e8413c83-4522-49ba-923a-6fa3a5bc9504 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:17:07.288151 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-e8413c83-4522-49ba-923a-6fa3a5bc9504 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:17:07.289444 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-e8413c83-4522-49ba-923a-6fa3a5bc9504 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "GET /compute/v2.1/servers/78c535d2-a4ae-43ff-bf93-8c35dfb79876" status: 200 len: 1722 microversion: 2.20 time: 0.161682 Oct 17 03:17:07.291122 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 342/717] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 03:17:07 2022] GET /compute/v2.1/servers/78c535d2-a4ae-43ff-bf93-8c35dfb79876 => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:17:08.204580 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-e5ecc58a-e930-441b-8d27-fd54b9c77c46 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:17:08.205178 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-e5ecc58a-e930-441b-8d27-fd54b9c77c46 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] [instance: 87c4c474-a5ab-4532-bffa-5b3d2cb15d55] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:17:08.211540 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-e5ecc58a-e930-441b-8d27-fd54b9c77c46 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:08.212087 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-e5ecc58a-e930-441b-8d27-fd54b9c77c46 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:08.212596 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-e5ecc58a-e930-441b-8d27-fd54b9c77c46 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:08.213198 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-e5ecc58a-e930-441b-8d27-fd54b9c77c46 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:08.213641 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-e5ecc58a-e930-441b-8d27-fd54b9c77c46 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:08.214059 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-e5ecc58a-e930-441b-8d27-fd54b9c77c46 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:08.315725 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-5b1e7c1e-34e9-4344-9359-3183f2b0dc5f tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:17:08.316314 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-5b1e7c1e-34e9-4344-9359-3183f2b0dc5f tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 78c535d2-a4ae-43ff-bf93-8c35dfb79876] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:17:08.322895 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-5b1e7c1e-34e9-4344-9359-3183f2b0dc5f tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:08.323380 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-5b1e7c1e-34e9-4344-9359-3183f2b0dc5f tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:08.323802 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-5b1e7c1e-34e9-4344-9359-3183f2b0dc5f tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:08.324486 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-5b1e7c1e-34e9-4344-9359-3183f2b0dc5f tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:08.324932 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-5b1e7c1e-34e9-4344-9359-3183f2b0dc5f tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:08.325345 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-5b1e7c1e-34e9-4344-9359-3183f2b0dc5f tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:08.347800 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-e5ecc58a-e930-441b-8d27-fd54b9c77c46 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c786544e8fb4e8e8c3a4990a0f36725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618cf0b3507845909bb27c13460d1d6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:17:08.356183 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-e5ecc58a-e930-441b-8d27-fd54b9c77c46 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] 10.222.0.27 "GET /compute/v2.1/servers/87c4c474-a5ab-4532-bffa-5b3d2cb15d55" status: 200 len: 1364 microversion: 2.1 time: 0.155384 Oct 17 03:17:08.356756 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 376/718] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:17:08 2022] GET /compute/v2.1/servers/87c4c474-a5ab-4532-bffa-5b3d2cb15d55 => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:17:08.461108 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-5b1e7c1e-34e9-4344-9359-3183f2b0dc5f tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:17:08.469143 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-5b1e7c1e-34e9-4344-9359-3183f2b0dc5f tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:17:08.470613 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-5b1e7c1e-34e9-4344-9359-3183f2b0dc5f tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:17:08.471785 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-5b1e7c1e-34e9-4344-9359-3183f2b0dc5f tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "GET /compute/v2.1/servers/78c535d2-a4ae-43ff-bf93-8c35dfb79876" status: 200 len: 1722 microversion: 2.20 time: 0.159888 Oct 17 03:17:08.472338 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 343/719] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 03:17:08 2022] GET /compute/v2.1/servers/78c535d2-a4ae-43ff-bf93-8c35dfb79876 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 03:17:08.679744 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [req-e3bd4500-440c-4ba5-bab1-935a2e43b846 req-0bdfe121-ef12-4d28-bb79-3a7ac2915a14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87c4c474-a5ab-4532-bffa-5b3d2cb15d55", "name": "network-vif-plugged", "status": "completed", "tag": "5ea75a02-e55b-48e9-bc6b-8eb295df879e"}]} {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:17:08.691342 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [req-e3bd4500-440c-4ba5-bab1-935a2e43b846 req-0bdfe121-ef12-4d28-bb79-3a7ac2915a14 service nova] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:08.691875 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [req-e3bd4500-440c-4ba5-bab1-935a2e43b846 req-0bdfe121-ef12-4d28-bb79-3a7ac2915a14 service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:08.692254 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [req-e3bd4500-440c-4ba5-bab1-935a2e43b846 req-0bdfe121-ef12-4d28-bb79-3a7ac2915a14 service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:08.703714 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.compute.server_external_events [req-e3bd4500-440c-4ba5-bab1-935a2e43b846 req-0bdfe121-ef12-4d28-bb79-3a7ac2915a14 service nova] Creating event network-vif-plugged:5ea75a02-e55b-48e9-bc6b-8eb295df879e for instance 87c4c474-a5ab-4532-bffa-5b3d2cb15d55 on hv-cinder-84697 Oct 17 03:17:08.708694 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [req-e3bd4500-440c-4ba5-bab1-935a2e43b846 req-0bdfe121-ef12-4d28-bb79-3a7ac2915a14 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032661 Oct 17 03:17:08.709484 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 377/720] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 03:17:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:17:09.379043 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-f170aab1-af5c-4d57-b1f6-941ed7cd3616 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:17:09.379651 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-f170aab1-af5c-4d57-b1f6-941ed7cd3616 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] [instance: 87c4c474-a5ab-4532-bffa-5b3d2cb15d55] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:17:09.386210 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-f170aab1-af5c-4d57-b1f6-941ed7cd3616 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:09.386695 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-f170aab1-af5c-4d57-b1f6-941ed7cd3616 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:09.387154 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-f170aab1-af5c-4d57-b1f6-941ed7cd3616 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:09.387855 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-f170aab1-af5c-4d57-b1f6-941ed7cd3616 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:09.388307 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-f170aab1-af5c-4d57-b1f6-941ed7cd3616 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:09.388731 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-f170aab1-af5c-4d57-b1f6-941ed7cd3616 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:09.498364 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-a2176aff-365f-49fb-b044-728b18cb9fe4 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:17:09.499291 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-a2176aff-365f-49fb-b044-728b18cb9fe4 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 78c535d2-a4ae-43ff-bf93-8c35dfb79876] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:17:09.501890 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG dbcounter [-] [118886] Writing DB stats nova_cell0:SELECT=4 {{(pid=118886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:17:09.508023 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-a2176aff-365f-49fb-b044-728b18cb9fe4 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:09.508505 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-a2176aff-365f-49fb-b044-728b18cb9fe4 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:09.509081 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-a2176aff-365f-49fb-b044-728b18cb9fe4 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:09.509775 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-a2176aff-365f-49fb-b044-728b18cb9fe4 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:09.510223 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-a2176aff-365f-49fb-b044-728b18cb9fe4 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:09.510671 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-a2176aff-365f-49fb-b044-728b18cb9fe4 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:09.519051 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-f170aab1-af5c-4d57-b1f6-941ed7cd3616 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c786544e8fb4e8e8c3a4990a0f36725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618cf0b3507845909bb27c13460d1d6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:17:09.527391 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-f170aab1-af5c-4d57-b1f6-941ed7cd3616 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] 10.222.0.27 "GET /compute/v2.1/servers/87c4c474-a5ab-4532-bffa-5b3d2cb15d55" status: 200 len: 1364 microversion: 2.1 time: 0.152148 Oct 17 03:17:09.527901 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 344/721] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:17:09 2022] GET /compute/v2.1/servers/87c4c474-a5ab-4532-bffa-5b3d2cb15d55 => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:17:09.639146 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-a2176aff-365f-49fb-b044-728b18cb9fe4 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:17:09.647331 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-a2176aff-365f-49fb-b044-728b18cb9fe4 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:17:09.648774 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-a2176aff-365f-49fb-b044-728b18cb9fe4 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:17:09.650553 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-a2176aff-365f-49fb-b044-728b18cb9fe4 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "GET /compute/v2.1/servers/78c535d2-a4ae-43ff-bf93-8c35dfb79876" status: 200 len: 1722 microversion: 2.20 time: 0.156650 Oct 17 03:17:09.651129 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 378/722] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 03:17:09 2022] GET /compute/v2.1/servers/78c535d2-a4ae-43ff-bf93-8c35dfb79876 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 03:17:10.551490 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-abc5fe2a-ab1d-4362-a99c-b0311171ab34 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:17:10.552164 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-abc5fe2a-ab1d-4362-a99c-b0311171ab34 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] [instance: 87c4c474-a5ab-4532-bffa-5b3d2cb15d55] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:17:10.558291 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-abc5fe2a-ab1d-4362-a99c-b0311171ab34 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:10.558885 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-abc5fe2a-ab1d-4362-a99c-b0311171ab34 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:10.559223 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-abc5fe2a-ab1d-4362-a99c-b0311171ab34 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:10.559914 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-abc5fe2a-ab1d-4362-a99c-b0311171ab34 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:10.560364 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-abc5fe2a-ab1d-4362-a99c-b0311171ab34 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:10.560787 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-abc5fe2a-ab1d-4362-a99c-b0311171ab34 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:10.676880 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-dddacc4a-b4eb-464d-9f8c-40e6f10ea08c tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:17:10.678332 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-dddacc4a-b4eb-464d-9f8c-40e6f10ea08c tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 78c535d2-a4ae-43ff-bf93-8c35dfb79876] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:17:10.686113 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-dddacc4a-b4eb-464d-9f8c-40e6f10ea08c tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:10.686671 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-dddacc4a-b4eb-464d-9f8c-40e6f10ea08c tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:10.687296 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-dddacc4a-b4eb-464d-9f8c-40e6f10ea08c tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:10.688003 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-dddacc4a-b4eb-464d-9f8c-40e6f10ea08c tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:10.688445 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-dddacc4a-b4eb-464d-9f8c-40e6f10ea08c tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:10.688893 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-dddacc4a-b4eb-464d-9f8c-40e6f10ea08c tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:10.692861 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-abc5fe2a-ab1d-4362-a99c-b0311171ab34 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c786544e8fb4e8e8c3a4990a0f36725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618cf0b3507845909bb27c13460d1d6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:17:10.700947 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-abc5fe2a-ab1d-4362-a99c-b0311171ab34 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] 10.222.0.27 "GET /compute/v2.1/servers/87c4c474-a5ab-4532-bffa-5b3d2cb15d55" status: 200 len: 1554 microversion: 2.1 time: 0.154030 Oct 17 03:17:10.715213 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 345/723] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:17:10 2022] GET /compute/v2.1/servers/87c4c474-a5ab-4532-bffa-5b3d2cb15d55 => generated 1554 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:17:10.723424 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-fcbd662a-ce9f-4876-8387-3cf9f09f5350 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:17:10.723914 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-fcbd662a-ce9f-4876-8387-3cf9f09f5350 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] [instance: 87c4c474-a5ab-4532-bffa-5b3d2cb15d55] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:17:10.730677 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-fcbd662a-ce9f-4876-8387-3cf9f09f5350 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:10.731199 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-fcbd662a-ce9f-4876-8387-3cf9f09f5350 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:10.731636 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-fcbd662a-ce9f-4876-8387-3cf9f09f5350 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:10.732338 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-fcbd662a-ce9f-4876-8387-3cf9f09f5350 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:10.732797 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-fcbd662a-ce9f-4876-8387-3cf9f09f5350 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:10.733216 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-fcbd662a-ce9f-4876-8387-3cf9f09f5350 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:10.818206 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-fcbd662a-ce9f-4876-8387-3cf9f09f5350 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] 10.222.0.27 "GET /compute/v2.1/servers/87c4c474-a5ab-4532-bffa-5b3d2cb15d55/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.098433 Oct 17 03:17:10.818800 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 346/724] 10.222.0.27 () {58 vars in 1275 bytes} [Mon Oct 17 03:17:10 2022] GET /compute/v2.1/servers/87c4c474-a5ab-4532-bffa-5b3d2cb15d55/os-interface => generated 284 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:17:10.837358 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-dddacc4a-b4eb-464d-9f8c-40e6f10ea08c tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:17:10.845533 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-dddacc4a-b4eb-464d-9f8c-40e6f10ea08c tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:17:10.846995 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-dddacc4a-b4eb-464d-9f8c-40e6f10ea08c tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:17:10.848207 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-dddacc4a-b4eb-464d-9f8c-40e6f10ea08c tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "GET /compute/v2.1/servers/78c535d2-a4ae-43ff-bf93-8c35dfb79876" status: 200 len: 1743 microversion: 2.20 time: 0.175588 Oct 17 03:17:10.848772 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 379/725] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 03:17:10 2022] GET /compute/v2.1/servers/78c535d2-a4ae-43ff-bf93-8c35dfb79876 => generated 1743 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:17:11.741486 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG dbcounter [-] [118887] Writing DB stats nova_cell0:SELECT=2 {{(pid=118887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:17:11.742340 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG dbcounter [-] [118887] Writing DB stats nova_cell0:SELECT=8 {{(pid=118887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:17:11.747914 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [req-4bfbe9cf-a395-4214-ad5c-f2f068496947 req-bdc22df8-c026-456c-9829-3706cb6b155b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87c4c474-a5ab-4532-bffa-5b3d2cb15d55", "tag": "5ea75a02-e55b-48e9-bc6b-8eb295df879e"}]} {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:17:11.757864 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [req-4bfbe9cf-a395-4214-ad5c-f2f068496947 req-bdc22df8-c026-456c-9829-3706cb6b155b service nova] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:11.758454 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [req-4bfbe9cf-a395-4214-ad5c-f2f068496947 req-bdc22df8-c026-456c-9829-3706cb6b155b service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:11.758976 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [req-4bfbe9cf-a395-4214-ad5c-f2f068496947 req-bdc22df8-c026-456c-9829-3706cb6b155b service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:11.770247 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.compute.server_external_events [req-4bfbe9cf-a395-4214-ad5c-f2f068496947 req-bdc22df8-c026-456c-9829-3706cb6b155b service nova] Creating event network-changed:5ea75a02-e55b-48e9-bc6b-8eb295df879e for instance 87c4c474-a5ab-4532-bffa-5b3d2cb15d55 on hv-cinder-84697 Oct 17 03:17:11.775874 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [req-4bfbe9cf-a395-4214-ad5c-f2f068496947 req-bdc22df8-c026-456c-9829-3706cb6b155b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035031 Oct 17 03:17:11.776478 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 347/726] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 03:17:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:17:11.874751 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-a46b08b0-9e73-4d3c-ad8d-019796e92ab6 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:17:11.875446 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-a46b08b0-9e73-4d3c-ad8d-019796e92ab6 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 78c535d2-a4ae-43ff-bf93-8c35dfb79876] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:17:11.881904 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-a46b08b0-9e73-4d3c-ad8d-019796e92ab6 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:11.882386 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-a46b08b0-9e73-4d3c-ad8d-019796e92ab6 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:11.882817 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-a46b08b0-9e73-4d3c-ad8d-019796e92ab6 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:11.883709 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-a46b08b0-9e73-4d3c-ad8d-019796e92ab6 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:11.884348 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-a46b08b0-9e73-4d3c-ad8d-019796e92ab6 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:11.884780 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-a46b08b0-9e73-4d3c-ad8d-019796e92ab6 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:12.025560 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-a46b08b0-9e73-4d3c-ad8d-019796e92ab6 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:17:12.036260 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-a46b08b0-9e73-4d3c-ad8d-019796e92ab6 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:17:12.037715 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-a46b08b0-9e73-4d3c-ad8d-019796e92ab6 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:17:12.038904 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-a46b08b0-9e73-4d3c-ad8d-019796e92ab6 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "GET /compute/v2.1/servers/78c535d2-a4ae-43ff-bf93-8c35dfb79876" status: 200 len: 1743 microversion: 2.20 time: 0.168006 Oct 17 03:17:12.040235 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 380/727] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 03:17:11 2022] GET /compute/v2.1/servers/78c535d2-a4ae-43ff-bf93-8c35dfb79876 => generated 1743 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:17:12.786795 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [req-e6b2af6b-22ae-4e24-86c2-cebd310667f5 req-02db6585-f956-4fbc-96fc-f7b474b3f493 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78c535d2-a4ae-43ff-bf93-8c35dfb79876", "name": "network-vif-plugged", "status": "completed", "tag": "0fcb1d19-78cc-466d-b47b-f0891a46de92"}]} {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:17:12.794655 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-5f73eff1-1e57-4df9-bd20-c3cb8be7d7d4 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:17:12.795586 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-5f73eff1-1e57-4df9-bd20-c3cb8be7d7d4 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: 712578d1-d2fb-4252-adbb-bc87096acc00] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:17:12.799773 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [req-e6b2af6b-22ae-4e24-86c2-cebd310667f5 req-02db6585-f956-4fbc-96fc-f7b474b3f493 service nova] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:12.800264 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [req-e6b2af6b-22ae-4e24-86c2-cebd310667f5 req-02db6585-f956-4fbc-96fc-f7b474b3f493 service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:12.800684 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [req-e6b2af6b-22ae-4e24-86c2-cebd310667f5 req-02db6585-f956-4fbc-96fc-f7b474b3f493 service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:12.802559 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-5f73eff1-1e57-4df9-bd20-c3cb8be7d7d4 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:12.803262 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-5f73eff1-1e57-4df9-bd20-c3cb8be7d7d4 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:12.803705 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-5f73eff1-1e57-4df9-bd20-c3cb8be7d7d4 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:12.804451 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-5f73eff1-1e57-4df9-bd20-c3cb8be7d7d4 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:12.805682 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-5f73eff1-1e57-4df9-bd20-c3cb8be7d7d4 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:12.806382 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-5f73eff1-1e57-4df9-bd20-c3cb8be7d7d4 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:12.813850 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.compute.server_external_events [req-e6b2af6b-22ae-4e24-86c2-cebd310667f5 req-02db6585-f956-4fbc-96fc-f7b474b3f493 service nova] Creating event network-vif-plugged:0fcb1d19-78cc-466d-b47b-f0891a46de92 for instance 78c535d2-a4ae-43ff-bf93-8c35dfb79876 on hv-cinder-84697 Oct 17 03:17:12.818891 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [req-e6b2af6b-22ae-4e24-86c2-cebd310667f5 req-02db6585-f956-4fbc-96fc-f7b474b3f493 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037025 Oct 17 03:17:12.819494 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 348/728] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 03:17:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:17:12.893997 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.objects.instance [None req-5f73eff1-1e57-4df9-bd20-c3cb8be7d7d4 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lazy-loading 'services' on Instance uuid 712578d1-d2fb-4252-adbb-bc87096acc00 {{(pid=118886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 03:17:12.968125 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-5f73eff1-1e57-4df9-bd20-c3cb8be7d7d4 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "DELETE /compute/v2.1/servers/712578d1-d2fb-4252-adbb-bc87096acc00/os-volume_attachments/9d69f510-3752-49d0-ab13-0ab7bff311d8" status: 202 len: 0 microversion: 2.1 time: 0.177633 Oct 17 03:17:12.968704 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 381/729] 10.222.0.27 () {58 vars in 1416 bytes} [Mon Oct 17 03:17:12 2022] DELETE /compute/v2.1/servers/712578d1-d2fb-4252-adbb-bc87096acc00/os-volume_attachments/9d69f510-3752-49d0-ab13-0ab7bff311d8 => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 17 03:17:12.978219 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-26d3aa53-24a7-4eeb-a2d1-0888cf373360 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:17:12.980484 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-26d3aa53-24a7-4eeb-a2d1-0888cf373360 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: 712578d1-d2fb-4252-adbb-bc87096acc00] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:17:12.986857 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-26d3aa53-24a7-4eeb-a2d1-0888cf373360 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:12.987603 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-26d3aa53-24a7-4eeb-a2d1-0888cf373360 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:12.988042 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-26d3aa53-24a7-4eeb-a2d1-0888cf373360 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:12.988967 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-26d3aa53-24a7-4eeb-a2d1-0888cf373360 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:12.989421 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-26d3aa53-24a7-4eeb-a2d1-0888cf373360 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:12.989959 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-26d3aa53-24a7-4eeb-a2d1-0888cf373360 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:13.019933 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-26d3aa53-24a7-4eeb-a2d1-0888cf373360 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "GET /compute/v2.1/servers/712578d1-d2fb-4252-adbb-bc87096acc00/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046558 Oct 17 03:17:13.020569 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 349/730] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 17 03:17:12 2022] GET /compute/v2.1/servers/712578d1-d2fb-4252-adbb-bc87096acc00/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:17:13.064998 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-3039e60d-e38c-48c4-aff0-dee1bb11753f tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:17:13.065734 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-3039e60d-e38c-48c4-aff0-dee1bb11753f tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 78c535d2-a4ae-43ff-bf93-8c35dfb79876] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:17:13.073599 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-3039e60d-e38c-48c4-aff0-dee1bb11753f tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:13.074172 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-3039e60d-e38c-48c4-aff0-dee1bb11753f tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:13.074603 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-3039e60d-e38c-48c4-aff0-dee1bb11753f tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:13.075358 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-3039e60d-e38c-48c4-aff0-dee1bb11753f tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:13.075811 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-3039e60d-e38c-48c4-aff0-dee1bb11753f tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:13.076232 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-3039e60d-e38c-48c4-aff0-dee1bb11753f tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:13.206007 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-3039e60d-e38c-48c4-aff0-dee1bb11753f tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:17:13.214632 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-3039e60d-e38c-48c4-aff0-dee1bb11753f tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:17:13.216116 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-3039e60d-e38c-48c4-aff0-dee1bb11753f tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:17:13.217272 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-3039e60d-e38c-48c4-aff0-dee1bb11753f tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "GET /compute/v2.1/servers/78c535d2-a4ae-43ff-bf93-8c35dfb79876" status: 200 len: 1743 microversion: 2.20 time: 0.156545 Oct 17 03:17:13.217825 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 382/731] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 03:17:13 2022] GET /compute/v2.1/servers/78c535d2-a4ae-43ff-bf93-8c35dfb79876 => generated 1743 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:17:14.033317 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-9ecd3108-2554-4bba-b804-9cc6fcf8edf7 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:17:14.035707 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-9ecd3108-2554-4bba-b804-9cc6fcf8edf7 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: 712578d1-d2fb-4252-adbb-bc87096acc00] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:17:14.042827 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-9ecd3108-2554-4bba-b804-9cc6fcf8edf7 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:14.043332 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-9ecd3108-2554-4bba-b804-9cc6fcf8edf7 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:14.043769 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-9ecd3108-2554-4bba-b804-9cc6fcf8edf7 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:14.044467 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-9ecd3108-2554-4bba-b804-9cc6fcf8edf7 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:14.044923 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-9ecd3108-2554-4bba-b804-9cc6fcf8edf7 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:14.045348 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-9ecd3108-2554-4bba-b804-9cc6fcf8edf7 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:14.074557 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-9ecd3108-2554-4bba-b804-9cc6fcf8edf7 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "GET /compute/v2.1/servers/712578d1-d2fb-4252-adbb-bc87096acc00/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045113 Oct 17 03:17:14.075160 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 350/732] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 17 03:17:14 2022] GET /compute/v2.1/servers/712578d1-d2fb-4252-adbb-bc87096acc00/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 03:17:14.166699 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-971a6a44-e86e-4872-8908-004c6bd82147 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:17:14.167429 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-971a6a44-e86e-4872-8908-004c6bd82147 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: 712578d1-d2fb-4252-adbb-bc87096acc00] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:17:14.173826 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-971a6a44-e86e-4872-8908-004c6bd82147 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:14.174310 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-971a6a44-e86e-4872-8908-004c6bd82147 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:14.174745 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-971a6a44-e86e-4872-8908-004c6bd82147 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:14.175493 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-971a6a44-e86e-4872-8908-004c6bd82147 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:14.175949 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-971a6a44-e86e-4872-8908-004c6bd82147 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:14.176374 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-971a6a44-e86e-4872-8908-004c6bd82147 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:14.203050 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-971a6a44-e86e-4872-8908-004c6bd82147 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: 712578d1-d2fb-4252-adbb-bc87096acc00] Going to try to terminate instance {{(pid=118886) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 03:17:14.243374 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-498a161e-6aa8-4dfd-a73a-753251f82b14 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:17:14.243997 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-498a161e-6aa8-4dfd-a73a-753251f82b14 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 78c535d2-a4ae-43ff-bf93-8c35dfb79876] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:17:14.250261 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-498a161e-6aa8-4dfd-a73a-753251f82b14 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:14.250718 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-498a161e-6aa8-4dfd-a73a-753251f82b14 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:14.251068 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-498a161e-6aa8-4dfd-a73a-753251f82b14 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:14.251751 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-498a161e-6aa8-4dfd-a73a-753251f82b14 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:14.252198 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-498a161e-6aa8-4dfd-a73a-753251f82b14 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:14.252619 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-498a161e-6aa8-4dfd-a73a-753251f82b14 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:14.285554 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-971a6a44-e86e-4872-8908-004c6bd82147 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "DELETE /compute/v2.1/servers/712578d1-d2fb-4252-adbb-bc87096acc00" status: 204 len: 0 microversion: 2.1 time: 0.123167 Oct 17 03:17:14.286075 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 383/733] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 03:17:14 2022] DELETE /compute/v2.1/servers/712578d1-d2fb-4252-adbb-bc87096acc00 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 03:17:14.296031 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-2f643ddd-5c14-45db-8720-b90b9d93da4b tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:17:14.297134 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-2f643ddd-5c14-45db-8720-b90b9d93da4b tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: 712578d1-d2fb-4252-adbb-bc87096acc00] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:17:14.303364 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-2f643ddd-5c14-45db-8720-b90b9d93da4b tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:14.303877 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-2f643ddd-5c14-45db-8720-b90b9d93da4b tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:14.304335 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-2f643ddd-5c14-45db-8720-b90b9d93da4b tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:14.305071 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-2f643ddd-5c14-45db-8720-b90b9d93da4b tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:14.306114 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-2f643ddd-5c14-45db-8720-b90b9d93da4b tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:14.306543 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-2f643ddd-5c14-45db-8720-b90b9d93da4b tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:14.447828 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-498a161e-6aa8-4dfd-a73a-753251f82b14 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:17:14.457275 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-498a161e-6aa8-4dfd-a73a-753251f82b14 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:17:14.459044 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-498a161e-6aa8-4dfd-a73a-753251f82b14 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:17:14.460594 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-498a161e-6aa8-4dfd-a73a-753251f82b14 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "GET /compute/v2.1/servers/78c535d2-a4ae-43ff-bf93-8c35dfb79876" status: 200 len: 1738 microversion: 2.20 time: 0.221809 Oct 17 03:17:14.478894 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-2f643ddd-5c14-45db-8720-b90b9d93da4b tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1787a9ef7c44e28076aaa80c0152fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee21a91b84794e80b208fe72b7f1e010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:17:14.478894 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-2f643ddd-5c14-45db-8720-b90b9d93da4b tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "GET /compute/v2.1/servers/712578d1-d2fb-4252-adbb-bc87096acc00" status: 200 len: 1689 microversion: 2.1 time: 0.184932 Oct 17 03:17:14.479575 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 351/735] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 03:17:14 2022] GET /compute/v2.1/servers/78c535d2-a4ae-43ff-bf93-8c35dfb79876 => generated 1738 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:17:14.481495 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 384/735] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:17:14 2022] GET /compute/v2.1/servers/712578d1-d2fb-4252-adbb-bc87096acc00 => generated 1689 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:17:15.488905 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-83bb9cb5-8ff3-4d34-a23a-12524b02619e tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:17:15.489514 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-83bb9cb5-8ff3-4d34-a23a-12524b02619e tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 78c535d2-a4ae-43ff-bf93-8c35dfb79876] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:17:15.501102 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-216874ba-373d-4c0d-bd75-4bddf247f281 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:17:15.501892 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-216874ba-373d-4c0d-bd75-4bddf247f281 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: 712578d1-d2fb-4252-adbb-bc87096acc00] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:17:15.506777 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-83bb9cb5-8ff3-4d34-a23a-12524b02619e tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:15.507296 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-83bb9cb5-8ff3-4d34-a23a-12524b02619e tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:15.507895 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-83bb9cb5-8ff3-4d34-a23a-12524b02619e tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:15.509387 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-83bb9cb5-8ff3-4d34-a23a-12524b02619e tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:15.509642 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-216874ba-373d-4c0d-bd75-4bddf247f281 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:15.510054 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-83bb9cb5-8ff3-4d34-a23a-12524b02619e tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:15.510472 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-216874ba-373d-4c0d-bd75-4bddf247f281 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:15.510614 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-83bb9cb5-8ff3-4d34-a23a-12524b02619e tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:15.511260 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-216874ba-373d-4c0d-bd75-4bddf247f281 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:15.512258 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-216874ba-373d-4c0d-bd75-4bddf247f281 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:15.512861 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-216874ba-373d-4c0d-bd75-4bddf247f281 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:15.513442 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-216874ba-373d-4c0d-bd75-4bddf247f281 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:15.668062 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-83bb9cb5-8ff3-4d34-a23a-12524b02619e tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:17:15.673045 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-216874ba-373d-4c0d-bd75-4bddf247f281 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1787a9ef7c44e28076aaa80c0152fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee21a91b84794e80b208fe72b7f1e010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:17:15.676350 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-83bb9cb5-8ff3-4d34-a23a-12524b02619e tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:17:15.678149 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-83bb9cb5-8ff3-4d34-a23a-12524b02619e tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:17:15.679611 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-83bb9cb5-8ff3-4d34-a23a-12524b02619e tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "GET /compute/v2.1/servers/78c535d2-a4ae-43ff-bf93-8c35dfb79876" status: 200 len: 1738 microversion: 2.20 time: 0.194571 Oct 17 03:17:15.690897 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-216874ba-373d-4c0d-bd75-4bddf247f281 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "GET /compute/v2.1/servers/712578d1-d2fb-4252-adbb-bc87096acc00" status: 200 len: 1689 microversion: 2.1 time: 0.186850 Oct 17 03:17:15.690897 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 385/736] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:17:15 2022] GET /compute/v2.1/servers/712578d1-d2fb-4252-adbb-bc87096acc00 => generated 1689 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:17:15.691708 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 352/737] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 03:17:15 2022] GET /compute/v2.1/servers/78c535d2-a4ae-43ff-bf93-8c35dfb79876 => generated 1738 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:17:16.706217 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-c3e733cc-155f-4cd8-8720-9b5ea4e9830b tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:17:16.706831 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-971901e5-5dc2-44ab-9515-d329d4067982 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:17:16.707438 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-c3e733cc-155f-4cd8-8720-9b5ea4e9830b tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 78c535d2-a4ae-43ff-bf93-8c35dfb79876] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:17:16.707564 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-971901e5-5dc2-44ab-9515-d329d4067982 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: 712578d1-d2fb-4252-adbb-bc87096acc00] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:17:16.714986 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-971901e5-5dc2-44ab-9515-d329d4067982 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:16.715941 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-971901e5-5dc2-44ab-9515-d329d4067982 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:16.716594 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-971901e5-5dc2-44ab-9515-d329d4067982 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:16.716738 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-c3e733cc-155f-4cd8-8720-9b5ea4e9830b tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:16.717595 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-971901e5-5dc2-44ab-9515-d329d4067982 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:16.717831 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-c3e733cc-155f-4cd8-8720-9b5ea4e9830b tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:16.718247 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-971901e5-5dc2-44ab-9515-d329d4067982 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:16.718596 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-c3e733cc-155f-4cd8-8720-9b5ea4e9830b tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:16.718858 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-971901e5-5dc2-44ab-9515-d329d4067982 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:16.719637 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-c3e733cc-155f-4cd8-8720-9b5ea4e9830b tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:16.720262 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-c3e733cc-155f-4cd8-8720-9b5ea4e9830b tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:16.721442 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-c3e733cc-155f-4cd8-8720-9b5ea4e9830b tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:16.870519 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-971901e5-5dc2-44ab-9515-d329d4067982 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1787a9ef7c44e28076aaa80c0152fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee21a91b84794e80b208fe72b7f1e010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:17:16.873535 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-c3e733cc-155f-4cd8-8720-9b5ea4e9830b tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:17:16.882172 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-c3e733cc-155f-4cd8-8720-9b5ea4e9830b tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:17:16.884741 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-c3e733cc-155f-4cd8-8720-9b5ea4e9830b tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:17:16.885944 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-c3e733cc-155f-4cd8-8720-9b5ea4e9830b tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "GET /compute/v2.1/servers/78c535d2-a4ae-43ff-bf93-8c35dfb79876" status: 200 len: 1738 microversion: 2.20 time: 0.183676 Oct 17 03:17:16.886515 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 386/738] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 03:17:16 2022] GET /compute/v2.1/servers/78c535d2-a4ae-43ff-bf93-8c35dfb79876 => generated 1738 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:17:16.886793 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-971901e5-5dc2-44ab-9515-d329d4067982 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "GET /compute/v2.1/servers/712578d1-d2fb-4252-adbb-bc87096acc00" status: 200 len: 1689 microversion: 2.1 time: 0.184123 Oct 17 03:17:16.887417 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 353/739] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:17:16 2022] GET /compute/v2.1/servers/712578d1-d2fb-4252-adbb-bc87096acc00 => generated 1689 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:17:17.922231 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-b62476b0-8459-47de-bc7d-87f54657f9d4 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:17:17.922945 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-b62476b0-8459-47de-bc7d-87f54657f9d4 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 78c535d2-a4ae-43ff-bf93-8c35dfb79876] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:17:17.926519 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-26433d98-f6be-4a28-820d-aada07da493c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:17:17.927702 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-26433d98-f6be-4a28-820d-aada07da493c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: 712578d1-d2fb-4252-adbb-bc87096acc00] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:17:17.942679 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-26433d98-f6be-4a28-820d-aada07da493c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:17.944639 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-26433d98-f6be-4a28-820d-aada07da493c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:17.948402 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-b62476b0-8459-47de-bc7d-87f54657f9d4 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:17.948837 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-26433d98-f6be-4a28-820d-aada07da493c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:17.949441 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-b62476b0-8459-47de-bc7d-87f54657f9d4 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:17.949645 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-26433d98-f6be-4a28-820d-aada07da493c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:17.950119 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-26433d98-f6be-4a28-820d-aada07da493c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:17.950516 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-b62476b0-8459-47de-bc7d-87f54657f9d4 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:17.950627 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-26433d98-f6be-4a28-820d-aada07da493c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:17.951615 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-b62476b0-8459-47de-bc7d-87f54657f9d4 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:17.952396 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-b62476b0-8459-47de-bc7d-87f54657f9d4 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:17.953148 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-b62476b0-8459-47de-bc7d-87f54657f9d4 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:18.121666 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-26433d98-f6be-4a28-820d-aada07da493c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1787a9ef7c44e28076aaa80c0152fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee21a91b84794e80b208fe72b7f1e010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:17:18.124733 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG dbcounter [-] [118886] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:17:18.129810 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-26433d98-f6be-4a28-820d-aada07da493c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "GET /compute/v2.1/servers/712578d1-d2fb-4252-adbb-bc87096acc00" status: 200 len: 1689 microversion: 2.1 time: 0.215997 Oct 17 03:17:18.130389 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 387/740] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:17:17 2022] GET /compute/v2.1/servers/712578d1-d2fb-4252-adbb-bc87096acc00 => generated 1689 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:17:18.233985 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-b62476b0-8459-47de-bc7d-87f54657f9d4 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:17:18.244904 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-b62476b0-8459-47de-bc7d-87f54657f9d4 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:17:18.246635 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-b62476b0-8459-47de-bc7d-87f54657f9d4 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:17:18.247814 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-b62476b0-8459-47de-bc7d-87f54657f9d4 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "GET /compute/v2.1/servers/78c535d2-a4ae-43ff-bf93-8c35dfb79876" status: 200 len: 1738 microversion: 2.20 time: 0.330416 Oct 17 03:17:18.249025 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 354/741] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 03:17:17 2022] GET /compute/v2.1/servers/78c535d2-a4ae-43ff-bf93-8c35dfb79876 => generated 1738 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:17:18.961746 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [req-aa268402-fef5-45f3-bf9f-6d7632cb285c req-af79b129-9a79-4008-aa39-de5d25f7d7d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "712578d1-d2fb-4252-adbb-bc87096acc00", "name": "network-vif-deleted", "tag": "f7a1e8a6-f7aa-40af-a627-0640f636cc4a"}]} {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:17:18.979758 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [req-aa268402-fef5-45f3-bf9f-6d7632cb285c req-af79b129-9a79-4008-aa39-de5d25f7d7d2 service nova] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:18.980611 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [req-aa268402-fef5-45f3-bf9f-6d7632cb285c req-af79b129-9a79-4008-aa39-de5d25f7d7d2 service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:18.981263 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [req-aa268402-fef5-45f3-bf9f-6d7632cb285c req-af79b129-9a79-4008-aa39-de5d25f7d7d2 service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:19.001493 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.compute.server_external_events [req-aa268402-fef5-45f3-bf9f-6d7632cb285c req-af79b129-9a79-4008-aa39-de5d25f7d7d2 service nova] Creating event network-vif-deleted:f7a1e8a6-f7aa-40af-a627-0640f636cc4a for instance 712578d1-d2fb-4252-adbb-bc87096acc00 on hv-cinder-84697 Oct 17 03:17:19.007886 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [req-aa268402-fef5-45f3-bf9f-6d7632cb285c req-af79b129-9a79-4008-aa39-de5d25f7d7d2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049666 Oct 17 03:17:19.008936 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 388/742] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 03:17:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:17:19.159944 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-36bd8d1f-f6a7-4886-a7e5-f7e6ae8a664f tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:17:19.161297 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-36bd8d1f-f6a7-4886-a7e5-f7e6ae8a664f tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: 712578d1-d2fb-4252-adbb-bc87096acc00] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:17:19.177200 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-36bd8d1f-f6a7-4886-a7e5-f7e6ae8a664f tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:19.178002 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-36bd8d1f-f6a7-4886-a7e5-f7e6ae8a664f tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:19.178947 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-36bd8d1f-f6a7-4886-a7e5-f7e6ae8a664f tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:19.183018 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-36bd8d1f-f6a7-4886-a7e5-f7e6ae8a664f tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:19.184140 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-36bd8d1f-f6a7-4886-a7e5-f7e6ae8a664f tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:19.185227 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-36bd8d1f-f6a7-4886-a7e5-f7e6ae8a664f tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:19.198426 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG dbcounter [-] [118887] Writing DB stats nova_cell1:SELECT=100 {{(pid=118887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:17:19.248401 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-36bd8d1f-f6a7-4886-a7e5-f7e6ae8a664f tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:19.249099 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-36bd8d1f-f6a7-4886-a7e5-f7e6ae8a664f tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:19.249867 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-36bd8d1f-f6a7-4886-a7e5-f7e6ae8a664f tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:19.250418 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.objects.instance [None req-36bd8d1f-f6a7-4886-a7e5-f7e6ae8a664f tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lazy-loading 'fault' on Instance uuid 712578d1-d2fb-4252-adbb-bc87096acc00 {{(pid=118887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 03:17:19.299641 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-6509e674-ae09-4ae8-b55a-0531bb3187ec tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:17:19.304472 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-6509e674-ae09-4ae8-b55a-0531bb3187ec tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 78c535d2-a4ae-43ff-bf93-8c35dfb79876] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:17:19.309425 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-36bd8d1f-f6a7-4886-a7e5-f7e6ae8a664f tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1787a9ef7c44e28076aaa80c0152fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee21a91b84794e80b208fe72b7f1e010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:17:19.319410 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-36bd8d1f-f6a7-4886-a7e5-f7e6ae8a664f tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "GET /compute/v2.1/servers/712578d1-d2fb-4252-adbb-bc87096acc00" status: 200 len: 1334 microversion: 2.1 time: 0.166850 Oct 17 03:17:19.331754 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 355/743] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:17:19 2022] GET /compute/v2.1/servers/712578d1-d2fb-4252-adbb-bc87096acc00 => generated 1334 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:17:19.337003 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-6509e674-ae09-4ae8-b55a-0531bb3187ec tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:19.337677 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-6509e674-ae09-4ae8-b55a-0531bb3187ec tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:19.338724 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-6509e674-ae09-4ae8-b55a-0531bb3187ec tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:19.339618 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-6509e674-ae09-4ae8-b55a-0531bb3187ec tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:19.340234 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-6509e674-ae09-4ae8-b55a-0531bb3187ec tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:19.340741 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-6509e674-ae09-4ae8-b55a-0531bb3187ec tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:19.547690 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-6509e674-ae09-4ae8-b55a-0531bb3187ec tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:17:19.558080 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-6509e674-ae09-4ae8-b55a-0531bb3187ec tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:17:19.559806 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-6509e674-ae09-4ae8-b55a-0531bb3187ec tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:17:19.561076 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-6509e674-ae09-4ae8-b55a-0531bb3187ec tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "GET /compute/v2.1/servers/78c535d2-a4ae-43ff-bf93-8c35dfb79876" status: 200 len: 1738 microversion: 2.20 time: 0.288154 Oct 17 03:17:19.561701 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 389/744] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 03:17:19 2022] GET /compute/v2.1/servers/78c535d2-a4ae-43ff-bf93-8c35dfb79876 => generated 1738 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 03:17:20.344060 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-35a516c2-3c4a-4879-b5a4-7fa1f082a02c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:17:20.344665 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-35a516c2-3c4a-4879-b5a4-7fa1f082a02c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: 712578d1-d2fb-4252-adbb-bc87096acc00] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:17:20.351379 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-35a516c2-3c4a-4879-b5a4-7fa1f082a02c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:20.351921 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-35a516c2-3c4a-4879-b5a4-7fa1f082a02c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:20.352481 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-35a516c2-3c4a-4879-b5a4-7fa1f082a02c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:20.353192 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-35a516c2-3c4a-4879-b5a4-7fa1f082a02c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:20.353650 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-35a516c2-3c4a-4879-b5a4-7fa1f082a02c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:20.354075 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-35a516c2-3c4a-4879-b5a4-7fa1f082a02c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:20.371314 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.wsgi [None req-35a516c2-3c4a-4879-b5a4-7fa1f082a02c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] HTTP exception thrown: Instance 712578d1-d2fb-4252-adbb-bc87096acc00 could not be found. Oct 17 03:17:20.373010 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-35a516c2-3c4a-4879-b5a4-7fa1f082a02c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Request method failure captured: Oct 17 03:17:20.373010 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: request: GET /compute/v2.1/servers/712578d1-d2fb-4252-adbb-bc87096acc00 HTTP/1.1 Oct 17 03:17:20.373010 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Accept: application/json Oct 17 03:17:20.373010 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Accept-Encoding: identity Oct 17 03:17:20.373010 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Connection: close Oct 17 03:17:20.373010 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Content-Length: 0 Oct 17 03:17:20.373010 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Content-Type: application/json Oct 17 03:17:20.373010 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Host: 10.222.0.27 Oct 17 03:17:20.373010 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Openstack-System-Scope: None Oct 17 03:17:20.373010 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: User-Agent: python-urllib3/1.26.12 Oct 17 03:17:20.373010 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Auth-Token: gAAAAABjTMf8n_6_Hk42-LQ3323zf7rLyhBkZ7TzI7iXmOD1LZOLQulk-a15ge0ewasywiXZ0G3F3f55kCah96aeBj6-Tg6x0QhgUp1XcnGW8u5zIwcRB_iergkiw_PISrGg1NTyyTzxZ2mz7vHEvQ-8c7ZO9C6TeQ_1FzcAq2bYh8NgMR7sjzA Oct 17 03:17:20.373010 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Domain-Id: None Oct 17 03:17:20.373010 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Domain-Name: None Oct 17 03:17:20.373010 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Identity-Status: Confirmed Oct 17 03:17:20.373010 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Is-Admin-Project: True Oct 17 03:17:20.373010 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Project-Domain-Id: default Oct 17 03:17:20.373010 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Project-Domain-Name: Default Oct 17 03:17:20.373010 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Project-Id: ee21a91b84794e80b208fe72b7f1e010 Oct 17 03:17:20.373010 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1171271233 Oct 17 03:17:20.373010 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Role: member,reader Oct 17 03:17:20.373010 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Roles: member,reader Oct 17 03:17:20.374605 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ee21a91b84794e80b208fe72b7f1e010"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ee21a91b84794e80b208fe72b7f1e010"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ee21a91b84794e80b208fe72b7f1e010"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ee21a91b84794e80b208fe72b7f1e010"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 17 03:17:20.374605 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1171271233 Oct 17 03:17:20.374605 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Tenant-Id: ee21a91b84794e80b208fe72b7f1e010 Oct 17 03:17:20.374605 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1171271233 Oct 17 03:17:20.374605 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-User: tempest-ServerRescueNegativeTestJSON-1171271233-project Oct 17 03:17:20.374605 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-User-Domain-Id: default Oct 17 03:17:20.374605 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-User-Domain-Name: Default Oct 17 03:17:20.374605 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-User-Id: 9c1787a9ef7c44e28076aaa80c0152fd Oct 17 03:17:20.374605 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1171271233-project Oct 17 03:17:20.374605 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: method: > Oct 17 03:17:20.374605 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: exception: Instance 712578d1-d2fb-4252-adbb-bc87096acc00 could not be found. Oct 17 03:17:20.374605 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: action_args: {'id': '712578d1-d2fb-4252-adbb-bc87096acc00'} Oct 17 03:17:20.375537 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 03:17:20.375537 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:17:20.375537 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 03:17:20.375537 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 03:17:20.375537 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 03:17:20.375537 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 03:17:20.375537 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 03:17:20.375537 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 03:17:20.375537 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 03:17:20.375537 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 03:17:20.375537 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 712578d1-d2fb-4252-adbb-bc87096acc00 could not be found. Oct 17 03:17:20.375537 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Oct 17 03:17:20.375537 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:17:20.375537 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Oct 17 03:17:20.375537 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:17:20.375537 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:17:20.375537 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:17:20.375537 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 03:17:20.375537 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 03:17:20.375537 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 03:17:20.376974 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 03:17:20.376974 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 03:17:20.376974 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 03:17:20.376974 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 03:17:20.376974 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 03:17:20.376974 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 03:17:20.376974 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 03:17:20.376974 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 712578d1-d2fb-4252-adbb-bc87096acc00 could not be found. Oct 17 03:17:20.376974 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Oct 17 03:17:20.376974 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:17:20.376974 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Oct 17 03:17:20.376974 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:17:20.376974 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:17:20.376974 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:17:20.376974 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 03:17:20.376974 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 03:17:20.376974 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 712578d1-d2fb-4252-adbb-bc87096acc00 could not be found. Oct 17 03:17:20.376974 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Oct 17 03:17:20.378145 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-35a516c2-3c4a-4879-b5a4-7fa1f082a02c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Returning 404 to user: Instance 712578d1-d2fb-4252-adbb-bc87096acc00 could not be found. {{(pid=118887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 03:17:20.378145 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-35a516c2-3c4a-4879-b5a4-7fa1f082a02c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "GET /compute/v2.1/servers/712578d1-d2fb-4252-adbb-bc87096acc00" status: 404 len: 111 microversion: 2.1 time: 0.034354 Oct 17 03:17:20.384193 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 356/745] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:17:20 2022] GET /compute/v2.1/servers/712578d1-d2fb-4252-adbb-bc87096acc00 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 03:17:20.386629 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-2e0ebd3f-cbe4-4969-8446-3e80503ef52a tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '.version_select at 0x7fc7016bfb80>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:17:20.415463 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-2e0ebd3f-cbe4-4969-8446-3e80503ef52a tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-611420744" status: 202 len: 0 microversion: 2.1 time: 0.035690 Oct 17 03:17:20.416574 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 390/746] 10.222.0.27 () {58 vars in 1218 bytes} [Mon Oct 17 03:17:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-611420744 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 03:17:20.605744 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-049fa12e-ad5c-4a20-9607-8d3fbbe9c8c4 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:17:20.605744 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-049fa12e-ad5c-4a20-9607-8d3fbbe9c8c4 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 78c535d2-a4ae-43ff-bf93-8c35dfb79876] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:17:20.613498 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-049fa12e-ad5c-4a20-9607-8d3fbbe9c8c4 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:20.614157 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-049fa12e-ad5c-4a20-9607-8d3fbbe9c8c4 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:20.614606 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-049fa12e-ad5c-4a20-9607-8d3fbbe9c8c4 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:20.615381 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-049fa12e-ad5c-4a20-9607-8d3fbbe9c8c4 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:20.615837 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-049fa12e-ad5c-4a20-9607-8d3fbbe9c8c4 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:20.616263 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-049fa12e-ad5c-4a20-9607-8d3fbbe9c8c4 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:20.896386 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-049fa12e-ad5c-4a20-9607-8d3fbbe9c8c4 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:17:20.905307 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-049fa12e-ad5c-4a20-9607-8d3fbbe9c8c4 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:17:20.909819 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-049fa12e-ad5c-4a20-9607-8d3fbbe9c8c4 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:17:20.909819 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-049fa12e-ad5c-4a20-9607-8d3fbbe9c8c4 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "GET /compute/v2.1/servers/78c535d2-a4ae-43ff-bf93-8c35dfb79876" status: 200 len: 1738 microversion: 2.20 time: 0.320491 Oct 17 03:17:20.923806 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 357/747] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 03:17:20 2022] GET /compute/v2.1/servers/78c535d2-a4ae-43ff-bf93-8c35dfb79876 => generated 1738 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 03:17:21.934915 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-c6b19922-3c4d-4d72-a987-eb1398b7f2dc tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:17:21.935521 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-c6b19922-3c4d-4d72-a987-eb1398b7f2dc tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 78c535d2-a4ae-43ff-bf93-8c35dfb79876] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:17:21.943541 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-c6b19922-3c4d-4d72-a987-eb1398b7f2dc tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:21.944260 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-c6b19922-3c4d-4d72-a987-eb1398b7f2dc tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:21.944869 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-c6b19922-3c4d-4d72-a987-eb1398b7f2dc tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:21.945843 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-c6b19922-3c4d-4d72-a987-eb1398b7f2dc tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:21.946417 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-c6b19922-3c4d-4d72-a987-eb1398b7f2dc tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:21.946664 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-c6b19922-3c4d-4d72-a987-eb1398b7f2dc tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:22.093100 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-c6b19922-3c4d-4d72-a987-eb1398b7f2dc tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:17:22.102939 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-c6b19922-3c4d-4d72-a987-eb1398b7f2dc tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:17:22.104904 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-c6b19922-3c4d-4d72-a987-eb1398b7f2dc tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:17:22.106361 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-c6b19922-3c4d-4d72-a987-eb1398b7f2dc tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "GET /compute/v2.1/servers/78c535d2-a4ae-43ff-bf93-8c35dfb79876" status: 200 len: 1738 microversion: 2.20 time: 0.175277 Oct 17 03:17:22.108117 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 391/748] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 03:17:21 2022] GET /compute/v2.1/servers/78c535d2-a4ae-43ff-bf93-8c35dfb79876 => generated 1738 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:17:23.134449 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-0c949223-f5d6-4387-a2f9-e341576f65e5 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:17:23.135094 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-0c949223-f5d6-4387-a2f9-e341576f65e5 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 78c535d2-a4ae-43ff-bf93-8c35dfb79876] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:17:23.142161 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-0c949223-f5d6-4387-a2f9-e341576f65e5 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:23.142650 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-0c949223-f5d6-4387-a2f9-e341576f65e5 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:23.143122 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-0c949223-f5d6-4387-a2f9-e341576f65e5 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:23.143824 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-0c949223-f5d6-4387-a2f9-e341576f65e5 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:23.144288 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-0c949223-f5d6-4387-a2f9-e341576f65e5 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:23.144830 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-0c949223-f5d6-4387-a2f9-e341576f65e5 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:23.297532 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-0c949223-f5d6-4387-a2f9-e341576f65e5 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:17:23.307959 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-0c949223-f5d6-4387-a2f9-e341576f65e5 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:17:23.309644 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-0c949223-f5d6-4387-a2f9-e341576f65e5 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:17:23.311500 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-0c949223-f5d6-4387-a2f9-e341576f65e5 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "GET /compute/v2.1/servers/78c535d2-a4ae-43ff-bf93-8c35dfb79876" status: 200 len: 1738 microversion: 2.20 time: 0.181750 Oct 17 03:17:23.322918 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 358/749] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 03:17:23 2022] GET /compute/v2.1/servers/78c535d2-a4ae-43ff-bf93-8c35dfb79876 => generated 1738 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:17:23.542706 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-caa75607-b74f-49ed-95ad-a0e8c6f74943 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:17:23.543797 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-caa75607-b74f-49ed-95ad-a0e8c6f74943 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: f430d340-f7ff-4805-bd00-69eeaf33250d] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:17:23.550662 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-caa75607-b74f-49ed-95ad-a0e8c6f74943 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:23.551247 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-caa75607-b74f-49ed-95ad-a0e8c6f74943 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:23.551767 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-caa75607-b74f-49ed-95ad-a0e8c6f74943 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:23.552528 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-caa75607-b74f-49ed-95ad-a0e8c6f74943 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:23.553052 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-caa75607-b74f-49ed-95ad-a0e8c6f74943 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:23.553545 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-caa75607-b74f-49ed-95ad-a0e8c6f74943 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:23.581610 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-caa75607-b74f-49ed-95ad-a0e8c6f74943 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: f430d340-f7ff-4805-bd00-69eeaf33250d] Going to try to terminate instance {{(pid=118886) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 03:17:23.670170 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-caa75607-b74f-49ed-95ad-a0e8c6f74943 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f430d340-f7ff-4805-bd00-69eeaf33250d" status: 204 len: 0 microversion: 2.1 time: 0.131682 Oct 17 03:17:23.670956 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 392/750] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 03:17:23 2022] DELETE /compute/v2.1/servers/f430d340-f7ff-4805-bd00-69eeaf33250d => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 03:17:23.679549 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-a6cd5a5a-3007-42d8-93ad-a1ec8825aa2c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:17:23.680294 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-a6cd5a5a-3007-42d8-93ad-a1ec8825aa2c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: f430d340-f7ff-4805-bd00-69eeaf33250d] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:17:23.686428 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-a6cd5a5a-3007-42d8-93ad-a1ec8825aa2c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:23.687020 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-a6cd5a5a-3007-42d8-93ad-a1ec8825aa2c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:23.687524 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-a6cd5a5a-3007-42d8-93ad-a1ec8825aa2c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:23.688281 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-a6cd5a5a-3007-42d8-93ad-a1ec8825aa2c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:23.688805 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-a6cd5a5a-3007-42d8-93ad-a1ec8825aa2c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:23.689301 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-a6cd5a5a-3007-42d8-93ad-a1ec8825aa2c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:23.821799 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-a6cd5a5a-3007-42d8-93ad-a1ec8825aa2c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1787a9ef7c44e28076aaa80c0152fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee21a91b84794e80b208fe72b7f1e010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:17:23.829490 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-a6cd5a5a-3007-42d8-93ad-a1ec8825aa2c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "GET /compute/v2.1/servers/f430d340-f7ff-4805-bd00-69eeaf33250d" status: 200 len: 1508 microversion: 2.1 time: 0.154219 Oct 17 03:17:23.830054 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 359/751] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:17:23 2022] GET /compute/v2.1/servers/f430d340-f7ff-4805-bd00-69eeaf33250d => generated 1508 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:17:24.338324 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-f260f775-9560-4572-a061-c01cc32f4fd1 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:17:24.339045 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-f260f775-9560-4572-a061-c01cc32f4fd1 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 78c535d2-a4ae-43ff-bf93-8c35dfb79876] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:17:24.345047 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-f260f775-9560-4572-a061-c01cc32f4fd1 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:24.345523 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-f260f775-9560-4572-a061-c01cc32f4fd1 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:24.345946 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-f260f775-9560-4572-a061-c01cc32f4fd1 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:24.346620 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-f260f775-9560-4572-a061-c01cc32f4fd1 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:24.347095 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-f260f775-9560-4572-a061-c01cc32f4fd1 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:24.347514 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-f260f775-9560-4572-a061-c01cc32f4fd1 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:24.474852 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-f260f775-9560-4572-a061-c01cc32f4fd1 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:17:24.482927 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-f260f775-9560-4572-a061-c01cc32f4fd1 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:17:24.484350 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-f260f775-9560-4572-a061-c01cc32f4fd1 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:17:24.485480 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-f260f775-9560-4572-a061-c01cc32f4fd1 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "GET /compute/v2.1/servers/78c535d2-a4ae-43ff-bf93-8c35dfb79876" status: 200 len: 1738 microversion: 2.20 time: 0.152070 Oct 17 03:17:24.486033 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 393/752] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 03:17:24 2022] GET /compute/v2.1/servers/78c535d2-a4ae-43ff-bf93-8c35dfb79876 => generated 1738 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:17:24.853510 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-603dc155-7b67-4a08-9b14-d33dea0601ee tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:17:24.854112 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-603dc155-7b67-4a08-9b14-d33dea0601ee tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: f430d340-f7ff-4805-bd00-69eeaf33250d] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:17:24.860536 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-603dc155-7b67-4a08-9b14-d33dea0601ee tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:24.861011 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-603dc155-7b67-4a08-9b14-d33dea0601ee tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:24.861438 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-603dc155-7b67-4a08-9b14-d33dea0601ee tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:24.862112 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-603dc155-7b67-4a08-9b14-d33dea0601ee tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:24.862559 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-603dc155-7b67-4a08-9b14-d33dea0601ee tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:24.863008 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-603dc155-7b67-4a08-9b14-d33dea0601ee tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:25.237520 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-603dc155-7b67-4a08-9b14-d33dea0601ee tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1787a9ef7c44e28076aaa80c0152fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee21a91b84794e80b208fe72b7f1e010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:17:25.245879 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-603dc155-7b67-4a08-9b14-d33dea0601ee tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "GET /compute/v2.1/servers/f430d340-f7ff-4805-bd00-69eeaf33250d" status: 200 len: 1508 microversion: 2.1 time: 0.396730 Oct 17 03:17:25.246447 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 360/753] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:17:24 2022] GET /compute/v2.1/servers/f430d340-f7ff-4805-bd00-69eeaf33250d => generated 1508 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:17:25.511471 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-ed520770-ac21-4a39-b9f4-a7b8c75dc5fa tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:17:25.512016 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-ed520770-ac21-4a39-b9f4-a7b8c75dc5fa tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 78c535d2-a4ae-43ff-bf93-8c35dfb79876] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:17:25.518522 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-ed520770-ac21-4a39-b9f4-a7b8c75dc5fa tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:25.519051 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-ed520770-ac21-4a39-b9f4-a7b8c75dc5fa tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:25.519485 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-ed520770-ac21-4a39-b9f4-a7b8c75dc5fa tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:25.520182 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-ed520770-ac21-4a39-b9f4-a7b8c75dc5fa tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:25.520631 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-ed520770-ac21-4a39-b9f4-a7b8c75dc5fa tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:25.521056 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-ed520770-ac21-4a39-b9f4-a7b8c75dc5fa tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:25.683505 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-ed520770-ac21-4a39-b9f4-a7b8c75dc5fa tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:17:25.692086 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-ed520770-ac21-4a39-b9f4-a7b8c75dc5fa tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:17:25.693532 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-ed520770-ac21-4a39-b9f4-a7b8c75dc5fa tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:17:25.694690 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-ed520770-ac21-4a39-b9f4-a7b8c75dc5fa tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "GET /compute/v2.1/servers/78c535d2-a4ae-43ff-bf93-8c35dfb79876" status: 200 len: 1738 microversion: 2.20 time: 0.187824 Oct 17 03:17:25.695289 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 394/754] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 03:17:25 2022] GET /compute/v2.1/servers/78c535d2-a4ae-43ff-bf93-8c35dfb79876 => generated 1738 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 03:17:26.268672 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-3c2b2315-fb12-4c75-ab01-f04206b9029c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:17:26.269343 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-3c2b2315-fb12-4c75-ab01-f04206b9029c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: f430d340-f7ff-4805-bd00-69eeaf33250d] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:17:26.275850 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-3c2b2315-fb12-4c75-ab01-f04206b9029c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:26.276335 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-3c2b2315-fb12-4c75-ab01-f04206b9029c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:26.276763 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-3c2b2315-fb12-4c75-ab01-f04206b9029c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:26.277456 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-3c2b2315-fb12-4c75-ab01-f04206b9029c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:26.277906 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-3c2b2315-fb12-4c75-ab01-f04206b9029c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:26.278323 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-3c2b2315-fb12-4c75-ab01-f04206b9029c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:26.611145 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-3c2b2315-fb12-4c75-ab01-f04206b9029c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1787a9ef7c44e28076aaa80c0152fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee21a91b84794e80b208fe72b7f1e010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:17:26.619465 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-3c2b2315-fb12-4c75-ab01-f04206b9029c tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "GET /compute/v2.1/servers/f430d340-f7ff-4805-bd00-69eeaf33250d" status: 200 len: 1508 microversion: 2.1 time: 0.354672 Oct 17 03:17:26.620035 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 361/755] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:17:26 2022] GET /compute/v2.1/servers/f430d340-f7ff-4805-bd00-69eeaf33250d => generated 1508 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:17:26.721517 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-c62dd44e-97c8-4666-9e18-4aff99f6bc87 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:17:26.722120 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-c62dd44e-97c8-4666-9e18-4aff99f6bc87 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 78c535d2-a4ae-43ff-bf93-8c35dfb79876] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:17:26.724557 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG dbcounter [-] [118886] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=1,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=118886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:17:26.730328 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-c62dd44e-97c8-4666-9e18-4aff99f6bc87 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:26.730799 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-c62dd44e-97c8-4666-9e18-4aff99f6bc87 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:26.731463 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-c62dd44e-97c8-4666-9e18-4aff99f6bc87 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:26.732154 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-c62dd44e-97c8-4666-9e18-4aff99f6bc87 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:26.732598 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-c62dd44e-97c8-4666-9e18-4aff99f6bc87 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:26.733015 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-c62dd44e-97c8-4666-9e18-4aff99f6bc87 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:26.867174 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-c62dd44e-97c8-4666-9e18-4aff99f6bc87 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:17:26.875553 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-c62dd44e-97c8-4666-9e18-4aff99f6bc87 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:17:26.877011 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-c62dd44e-97c8-4666-9e18-4aff99f6bc87 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:17:26.878175 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-c62dd44e-97c8-4666-9e18-4aff99f6bc87 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "GET /compute/v2.1/servers/78c535d2-a4ae-43ff-bf93-8c35dfb79876" status: 200 len: 1720 microversion: 2.20 time: 0.160502 Oct 17 03:17:26.878738 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 395/756] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 03:17:26 2022] GET /compute/v2.1/servers/78c535d2-a4ae-43ff-bf93-8c35dfb79876 => generated 1720 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:17:27.236556 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [req-e70b1009-a09b-41bd-95b8-0f269468029e req-162c6200-792f-4c33-8fd8-4257add08123 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f430d340-f7ff-4805-bd00-69eeaf33250d", "name": "network-vif-deleted", "tag": "5c656ce8-361e-4b32-8e55-8e2061a8f354"}]} {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:17:27.241469 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG dbcounter [-] [118887] Writing DB stats nova_api:SELECT=80,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=118887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:17:27.248421 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [req-e70b1009-a09b-41bd-95b8-0f269468029e req-162c6200-792f-4c33-8fd8-4257add08123 service nova] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:27.248901 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [req-e70b1009-a09b-41bd-95b8-0f269468029e req-162c6200-792f-4c33-8fd8-4257add08123 service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:27.249332 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [req-e70b1009-a09b-41bd-95b8-0f269468029e req-162c6200-792f-4c33-8fd8-4257add08123 service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:27.263576 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.compute.server_external_events [req-e70b1009-a09b-41bd-95b8-0f269468029e req-162c6200-792f-4c33-8fd8-4257add08123 service nova] Creating event network-vif-deleted:5c656ce8-361e-4b32-8e55-8e2061a8f354 for instance f430d340-f7ff-4805-bd00-69eeaf33250d on hv-cinder-84697 Oct 17 03:17:27.268632 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [req-e70b1009-a09b-41bd-95b8-0f269468029e req-162c6200-792f-4c33-8fd8-4257add08123 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135273 Oct 17 03:17:27.269231 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 362/757] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 03:17:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:17:27.642056 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-ce0a3e3c-7c57-4510-806f-a4eb6f2018cc tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:17:27.642565 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-ce0a3e3c-7c57-4510-806f-a4eb6f2018cc tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: f430d340-f7ff-4805-bd00-69eeaf33250d] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:17:27.648504 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-ce0a3e3c-7c57-4510-806f-a4eb6f2018cc tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:27.649443 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-ce0a3e3c-7c57-4510-806f-a4eb6f2018cc tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:27.649879 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-ce0a3e3c-7c57-4510-806f-a4eb6f2018cc tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:27.650557 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-ce0a3e3c-7c57-4510-806f-a4eb6f2018cc tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:27.651044 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-ce0a3e3c-7c57-4510-806f-a4eb6f2018cc tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:27.651462 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-ce0a3e3c-7c57-4510-806f-a4eb6f2018cc tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:27.682088 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-ce0a3e3c-7c57-4510-806f-a4eb6f2018cc tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:27.682558 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-ce0a3e3c-7c57-4510-806f-a4eb6f2018cc tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:27.683017 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-ce0a3e3c-7c57-4510-806f-a4eb6f2018cc tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:27.683455 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.objects.instance [None req-ce0a3e3c-7c57-4510-806f-a4eb6f2018cc tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lazy-loading 'fault' on Instance uuid f430d340-f7ff-4805-bd00-69eeaf33250d {{(pid=118886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 03:17:27.727063 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-ce0a3e3c-7c57-4510-806f-a4eb6f2018cc tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1787a9ef7c44e28076aaa80c0152fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee21a91b84794e80b208fe72b7f1e010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:17:27.734997 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-ce0a3e3c-7c57-4510-806f-a4eb6f2018cc tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "GET /compute/v2.1/servers/f430d340-f7ff-4805-bd00-69eeaf33250d" status: 200 len: 1312 microversion: 2.1 time: 0.096811 Oct 17 03:17:27.735551 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 396/758] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:17:27 2022] GET /compute/v2.1/servers/f430d340-f7ff-4805-bd00-69eeaf33250d => generated 1312 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:17:27.904324 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-3ab86820-5750-4241-9a83-1e9d5a70a9aa tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:17:27.904941 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-3ab86820-5750-4241-9a83-1e9d5a70a9aa tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 78c535d2-a4ae-43ff-bf93-8c35dfb79876] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:17:27.911270 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-3ab86820-5750-4241-9a83-1e9d5a70a9aa tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:27.911744 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-3ab86820-5750-4241-9a83-1e9d5a70a9aa tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:27.912174 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-3ab86820-5750-4241-9a83-1e9d5a70a9aa tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:27.912846 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-3ab86820-5750-4241-9a83-1e9d5a70a9aa tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:27.913293 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-3ab86820-5750-4241-9a83-1e9d5a70a9aa tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:27.913707 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-3ab86820-5750-4241-9a83-1e9d5a70a9aa tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:28.041556 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-3ab86820-5750-4241-9a83-1e9d5a70a9aa tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:17:28.049458 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-3ab86820-5750-4241-9a83-1e9d5a70a9aa tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:17:28.050912 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-3ab86820-5750-4241-9a83-1e9d5a70a9aa tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:17:28.052044 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-3ab86820-5750-4241-9a83-1e9d5a70a9aa tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "GET /compute/v2.1/servers/78c535d2-a4ae-43ff-bf93-8c35dfb79876" status: 200 len: 1720 microversion: 2.20 time: 0.152501 Oct 17 03:17:28.052587 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 363/759] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 03:17:27 2022] GET /compute/v2.1/servers/78c535d2-a4ae-43ff-bf93-8c35dfb79876 => generated 1720 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:17:28.758809 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-7a56d16e-21a4-48c4-8a65-d5d797cda525 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:17:28.759740 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-7a56d16e-21a4-48c4-8a65-d5d797cda525 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: f430d340-f7ff-4805-bd00-69eeaf33250d] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:17:28.766342 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-7a56d16e-21a4-48c4-8a65-d5d797cda525 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:28.766832 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-7a56d16e-21a4-48c4-8a65-d5d797cda525 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:28.767304 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-7a56d16e-21a4-48c4-8a65-d5d797cda525 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:28.768002 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-7a56d16e-21a4-48c4-8a65-d5d797cda525 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:28.768462 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-7a56d16e-21a4-48c4-8a65-d5d797cda525 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:28.768885 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-7a56d16e-21a4-48c4-8a65-d5d797cda525 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:28.801541 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-7a56d16e-21a4-48c4-8a65-d5d797cda525 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:28.802032 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-7a56d16e-21a4-48c4-8a65-d5d797cda525 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:28.802476 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-7a56d16e-21a4-48c4-8a65-d5d797cda525 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:28.803012 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.objects.instance [None req-7a56d16e-21a4-48c4-8a65-d5d797cda525 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lazy-loading 'fault' on Instance uuid f430d340-f7ff-4805-bd00-69eeaf33250d {{(pid=118886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 03:17:28.843572 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-7a56d16e-21a4-48c4-8a65-d5d797cda525 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1787a9ef7c44e28076aaa80c0152fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee21a91b84794e80b208fe72b7f1e010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:17:28.851302 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-7a56d16e-21a4-48c4-8a65-d5d797cda525 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "GET /compute/v2.1/servers/f430d340-f7ff-4805-bd00-69eeaf33250d" status: 200 len: 1312 microversion: 2.1 time: 0.096483 Oct 17 03:17:28.852604 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 397/760] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:17:28 2022] GET /compute/v2.1/servers/f430d340-f7ff-4805-bd00-69eeaf33250d => generated 1312 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:17:29.077405 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-bce7a767-0bf0-4b99-b8c2-6b6a4f2ce91c tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:17:29.078003 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-bce7a767-0bf0-4b99-b8c2-6b6a4f2ce91c tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 78c535d2-a4ae-43ff-bf93-8c35dfb79876] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:17:29.084357 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-bce7a767-0bf0-4b99-b8c2-6b6a4f2ce91c tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:29.084831 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-bce7a767-0bf0-4b99-b8c2-6b6a4f2ce91c tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:29.085265 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-bce7a767-0bf0-4b99-b8c2-6b6a4f2ce91c tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:29.085937 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-bce7a767-0bf0-4b99-b8c2-6b6a4f2ce91c tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:29.086915 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-bce7a767-0bf0-4b99-b8c2-6b6a4f2ce91c tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:29.087441 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-bce7a767-0bf0-4b99-b8c2-6b6a4f2ce91c tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:29.222021 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-bce7a767-0bf0-4b99-b8c2-6b6a4f2ce91c tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:17:29.230996 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-bce7a767-0bf0-4b99-b8c2-6b6a4f2ce91c tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:17:29.232514 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-bce7a767-0bf0-4b99-b8c2-6b6a4f2ce91c tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:17:29.233735 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-bce7a767-0bf0-4b99-b8c2-6b6a4f2ce91c tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "GET /compute/v2.1/servers/78c535d2-a4ae-43ff-bf93-8c35dfb79876" status: 200 len: 1723 microversion: 2.20 time: 0.160200 Oct 17 03:17:29.234362 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 364/761] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 03:17:29 2022] GET /compute/v2.1/servers/78c535d2-a4ae-43ff-bf93-8c35dfb79876 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:17:29.260148 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-e1164b85-5803-40b7-b3ca-68d2d52088bd tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ba2bf6b8-40f9-4e12-82a4-4571b8900124"}} {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:17:29.262912 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-e1164b85-5803-40b7-b3ca-68d2d52088bd tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 78c535d2-a4ae-43ff-bf93-8c35dfb79876] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:17:29.269407 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-e1164b85-5803-40b7-b3ca-68d2d52088bd tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:29.269888 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-e1164b85-5803-40b7-b3ca-68d2d52088bd tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:29.270309 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-e1164b85-5803-40b7-b3ca-68d2d52088bd tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:29.271030 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-e1164b85-5803-40b7-b3ca-68d2d52088bd tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:29.271503 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-e1164b85-5803-40b7-b3ca-68d2d52088bd tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:29.271919 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-e1164b85-5803-40b7-b3ca-68d2d52088bd tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:29.557167 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-e1164b85-5803-40b7-b3ca-68d2d52088bd tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "POST /compute/v2.1/servers/78c535d2-a4ae-43ff-bf93-8c35dfb79876/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.301808 Oct 17 03:17:29.557765 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 398/762] 10.222.0.27 () {62 vars in 1364 bytes} [Mon Oct 17 03:17:29 2022] POST /compute/v2.1/servers/78c535d2-a4ae-43ff-bf93-8c35dfb79876/os-volume_attachments => generated 188 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 03:17:29.685896 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-f7845d1b-c0de-412c-aab3-3d9cbbb8f32d tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:17:29.686380 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-f7845d1b-c0de-412c-aab3-3d9cbbb8f32d tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 78c535d2-a4ae-43ff-bf93-8c35dfb79876] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:17:29.692258 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-f7845d1b-c0de-412c-aab3-3d9cbbb8f32d tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:29.692956 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-f7845d1b-c0de-412c-aab3-3d9cbbb8f32d tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:29.693353 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-f7845d1b-c0de-412c-aab3-3d9cbbb8f32d tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:29.694389 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-f7845d1b-c0de-412c-aab3-3d9cbbb8f32d tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:29.694905 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-f7845d1b-c0de-412c-aab3-3d9cbbb8f32d tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:29.696271 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-f7845d1b-c0de-412c-aab3-3d9cbbb8f32d tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:29.873515 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-45750458-fd6e-48a3-92eb-ce21174a7338 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:17:29.874046 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-45750458-fd6e-48a3-92eb-ce21174a7338 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: f430d340-f7ff-4805-bd00-69eeaf33250d] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:17:29.880347 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-45750458-fd6e-48a3-92eb-ce21174a7338 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:29.880817 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-45750458-fd6e-48a3-92eb-ce21174a7338 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:29.881243 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-45750458-fd6e-48a3-92eb-ce21174a7338 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:29.881920 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-45750458-fd6e-48a3-92eb-ce21174a7338 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:29.882366 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-45750458-fd6e-48a3-92eb-ce21174a7338 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:29.882779 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-45750458-fd6e-48a3-92eb-ce21174a7338 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:29.896939 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.wsgi [None req-45750458-fd6e-48a3-92eb-ce21174a7338 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] HTTP exception thrown: Instance f430d340-f7ff-4805-bd00-69eeaf33250d could not be found. Oct 17 03:17:29.899299 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-45750458-fd6e-48a3-92eb-ce21174a7338 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Request method failure captured: Oct 17 03:17:29.899299 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: request: GET /compute/v2.1/servers/f430d340-f7ff-4805-bd00-69eeaf33250d HTTP/1.1 Oct 17 03:17:29.899299 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Accept: application/json Oct 17 03:17:29.899299 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Accept-Encoding: identity Oct 17 03:17:29.899299 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Connection: close Oct 17 03:17:29.899299 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Content-Length: 0 Oct 17 03:17:29.899299 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Content-Type: application/json Oct 17 03:17:29.899299 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Host: 10.222.0.27 Oct 17 03:17:29.899299 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Openstack-System-Scope: None Oct 17 03:17:29.899299 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: User-Agent: python-urllib3/1.26.12 Oct 17 03:17:29.899299 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Auth-Token: gAAAAABjTMf8n_6_Hk42-LQ3323zf7rLyhBkZ7TzI7iXmOD1LZOLQulk-a15ge0ewasywiXZ0G3F3f55kCah96aeBj6-Tg6x0QhgUp1XcnGW8u5zIwcRB_iergkiw_PISrGg1NTyyTzxZ2mz7vHEvQ-8c7ZO9C6TeQ_1FzcAq2bYh8NgMR7sjzA Oct 17 03:17:29.899299 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Domain-Id: None Oct 17 03:17:29.899299 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Domain-Name: None Oct 17 03:17:29.899299 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Identity-Status: Confirmed Oct 17 03:17:29.899299 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Is-Admin-Project: True Oct 17 03:17:29.899299 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Project-Domain-Id: default Oct 17 03:17:29.899299 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Project-Domain-Name: Default Oct 17 03:17:29.899299 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Project-Id: ee21a91b84794e80b208fe72b7f1e010 Oct 17 03:17:29.899299 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1171271233 Oct 17 03:17:29.899299 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Role: member,reader Oct 17 03:17:29.899299 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Roles: member,reader Oct 17 03:17:29.900924 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ee21a91b84794e80b208fe72b7f1e010"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ee21a91b84794e80b208fe72b7f1e010"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ee21a91b84794e80b208fe72b7f1e010"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ee21a91b84794e80b208fe72b7f1e010"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 17 03:17:29.900924 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1171271233 Oct 17 03:17:29.900924 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Tenant-Id: ee21a91b84794e80b208fe72b7f1e010 Oct 17 03:17:29.900924 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1171271233 Oct 17 03:17:29.900924 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-User: tempest-ServerRescueNegativeTestJSON-1171271233-project Oct 17 03:17:29.900924 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-User-Domain-Id: default Oct 17 03:17:29.900924 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-User-Domain-Name: Default Oct 17 03:17:29.900924 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-User-Id: 9c1787a9ef7c44e28076aaa80c0152fd Oct 17 03:17:29.900924 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1171271233-project Oct 17 03:17:29.900924 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: method: > Oct 17 03:17:29.900924 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: exception: Instance f430d340-f7ff-4805-bd00-69eeaf33250d could not be found. Oct 17 03:17:29.900924 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: action_args: {'id': 'f430d340-f7ff-4805-bd00-69eeaf33250d'} Oct 17 03:17:29.901805 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 03:17:29.901805 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:17:29.901805 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 03:17:29.901805 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 03:17:29.901805 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 03:17:29.901805 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 03:17:29.901805 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 03:17:29.901805 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 03:17:29.901805 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 03:17:29.901805 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 03:17:29.901805 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f430d340-f7ff-4805-bd00-69eeaf33250d could not be found. Oct 17 03:17:29.901805 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Oct 17 03:17:29.901805 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:17:29.901805 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Oct 17 03:17:29.901805 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:17:29.901805 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:17:29.901805 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:17:29.901805 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 03:17:29.901805 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 03:17:29.901805 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 03:17:29.903380 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 03:17:29.903380 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 03:17:29.903380 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 03:17:29.903380 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 03:17:29.903380 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 03:17:29.903380 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 03:17:29.903380 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 03:17:29.903380 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f430d340-f7ff-4805-bd00-69eeaf33250d could not be found. Oct 17 03:17:29.903380 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Oct 17 03:17:29.903380 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:17:29.903380 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Oct 17 03:17:29.903380 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:17:29.903380 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:17:29.903380 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:17:29.903380 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 03:17:29.903380 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 03:17:29.903380 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f430d340-f7ff-4805-bd00-69eeaf33250d could not be found. Oct 17 03:17:29.903380 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Oct 17 03:17:29.905305 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-45750458-fd6e-48a3-92eb-ce21174a7338 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Returning 404 to user: Instance f430d340-f7ff-4805-bd00-69eeaf33250d could not be found. {{(pid=118886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 03:17:29.906130 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-45750458-fd6e-48a3-92eb-ce21174a7338 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "GET /compute/v2.1/servers/f430d340-f7ff-4805-bd00-69eeaf33250d" status: 404 len: 111 microversion: 2.1 time: 0.036591 Oct 17 03:17:29.906673 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 399/763] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:17:29 2022] GET /compute/v2.1/servers/f430d340-f7ff-4805-bd00-69eeaf33250d => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 03:17:29.915529 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-2fd6bc45-f153-4bd4-859c-e7e74d61ff49 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:17:29.916020 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-2fd6bc45-f153-4bd4-859c-e7e74d61ff49 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: 90f2768b-8259-439c-af06-7eff342615ee] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:17:29.922653 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-2fd6bc45-f153-4bd4-859c-e7e74d61ff49 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:29.923211 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-2fd6bc45-f153-4bd4-859c-e7e74d61ff49 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:29.923643 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-2fd6bc45-f153-4bd4-859c-e7e74d61ff49 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:29.924331 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-2fd6bc45-f153-4bd4-859c-e7e74d61ff49 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:29.924774 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-2fd6bc45-f153-4bd4-859c-e7e74d61ff49 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:29.925184 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-2fd6bc45-f153-4bd4-859c-e7e74d61ff49 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:29.937152 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-f7845d1b-c0de-412c-aab3-3d9cbbb8f32d tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "DELETE /compute/v2.1/servers/78c535d2-a4ae-43ff-bf93-8c35dfb79876/os-volume_attachments/ba2bf6b8-40f9-4e12-82a4-4571b8900124" status: 202 len: 0 microversion: 2.20 time: 0.255121 Oct 17 03:17:29.937737 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 365/764] 10.222.0.27 () {60 vars in 1457 bytes} [Mon Oct 17 03:17:29 2022] DELETE /compute/v2.1/servers/78c535d2-a4ae-43ff-bf93-8c35dfb79876/os-volume_attachments/ba2bf6b8-40f9-4e12-82a4-4571b8900124 => generated 0 bytes in 257 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 17 03:17:29.951018 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-2fd6bc45-f153-4bd4-859c-e7e74d61ff49 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: 90f2768b-8259-439c-af06-7eff342615ee] Going to try to terminate instance {{(pid=118886) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 03:17:29.986351 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG dbcounter [-] [118886] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=6,nova_cell1:INSERT=4 {{(pid=118886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:17:30.001896 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-b7e704d9-0ab2-4ccb-9db8-89dbf05873b3 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:17:30.002472 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-b7e704d9-0ab2-4ccb-9db8-89dbf05873b3 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 78c535d2-a4ae-43ff-bf93-8c35dfb79876] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:17:30.010026 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-b7e704d9-0ab2-4ccb-9db8-89dbf05873b3 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:30.010506 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-b7e704d9-0ab2-4ccb-9db8-89dbf05873b3 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:30.011019 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-b7e704d9-0ab2-4ccb-9db8-89dbf05873b3 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:30.011843 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-b7e704d9-0ab2-4ccb-9db8-89dbf05873b3 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:30.012319 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-b7e704d9-0ab2-4ccb-9db8-89dbf05873b3 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:30.013085 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-b7e704d9-0ab2-4ccb-9db8-89dbf05873b3 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:30.033151 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-2fd6bc45-f153-4bd4-859c-e7e74d61ff49 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "DELETE /compute/v2.1/servers/90f2768b-8259-439c-af06-7eff342615ee" status: 204 len: 0 microversion: 2.1 time: 0.121866 Oct 17 03:17:30.033832 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 400/765] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 03:17:29 2022] DELETE /compute/v2.1/servers/90f2768b-8259-439c-af06-7eff342615ee => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 03:17:30.042717 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-0120f86e-b697-4723-aada-d024f5557ec5 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:17:30.043447 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-0120f86e-b697-4723-aada-d024f5557ec5 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: 90f2768b-8259-439c-af06-7eff342615ee] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:17:30.049578 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-0120f86e-b697-4723-aada-d024f5557ec5 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:30.050061 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-0120f86e-b697-4723-aada-d024f5557ec5 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:30.050494 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-0120f86e-b697-4723-aada-d024f5557ec5 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:30.051244 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-0120f86e-b697-4723-aada-d024f5557ec5 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:30.051746 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-0120f86e-b697-4723-aada-d024f5557ec5 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:30.052115 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-0120f86e-b697-4723-aada-d024f5557ec5 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:30.061570 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-b7e704d9-0ab2-4ccb-9db8-89dbf05873b3 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 78c535d2-a4ae-43ff-bf93-8c35dfb79876] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=118887) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 17 03:17:30.130646 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-b7e704d9-0ab2-4ccb-9db8-89dbf05873b3 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "POST /compute/v2.1/servers/78c535d2-a4ae-43ff-bf93-8c35dfb79876/action" status: 202 len: 0 microversion: 2.20 time: 0.132865 Oct 17 03:17:30.134676 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 366/766] 10.222.0.27 () {62 vars in 1319 bytes} [Mon Oct 17 03:17:29 2022] POST /compute/v2.1/servers/78c535d2-a4ae-43ff-bf93-8c35dfb79876/action => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 17 03:17:30.139385 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-3b82c364-7cf3-46b3-a3da-5faef8bf2c91 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:17:30.139983 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-3b82c364-7cf3-46b3-a3da-5faef8bf2c91 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 78c535d2-a4ae-43ff-bf93-8c35dfb79876] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:17:30.145826 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-3b82c364-7cf3-46b3-a3da-5faef8bf2c91 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:30.146304 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-3b82c364-7cf3-46b3-a3da-5faef8bf2c91 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:30.146728 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-3b82c364-7cf3-46b3-a3da-5faef8bf2c91 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:30.147512 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-3b82c364-7cf3-46b3-a3da-5faef8bf2c91 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:30.148251 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-3b82c364-7cf3-46b3-a3da-5faef8bf2c91 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:30.148401 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-3b82c364-7cf3-46b3-a3da-5faef8bf2c91 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:30.202580 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-0120f86e-b697-4723-aada-d024f5557ec5 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1787a9ef7c44e28076aaa80c0152fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee21a91b84794e80b208fe72b7f1e010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:17:30.212360 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-0120f86e-b697-4723-aada-d024f5557ec5 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "GET /compute/v2.1/servers/90f2768b-8259-439c-af06-7eff342615ee" status: 200 len: 1522 microversion: 2.1 time: 0.173784 Oct 17 03:17:30.213409 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 401/767] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:17:30 2022] GET /compute/v2.1/servers/90f2768b-8259-439c-af06-7eff342615ee => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:17:30.285783 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-3b82c364-7cf3-46b3-a3da-5faef8bf2c91 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:17:30.294725 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-3b82c364-7cf3-46b3-a3da-5faef8bf2c91 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:17:30.296569 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-3b82c364-7cf3-46b3-a3da-5faef8bf2c91 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:17:30.297628 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-3b82c364-7cf3-46b3-a3da-5faef8bf2c91 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "GET /compute/v2.1/servers/78c535d2-a4ae-43ff-bf93-8c35dfb79876" status: 200 len: 1671 microversion: 2.20 time: 0.161934 Oct 17 03:17:30.298196 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 367/768] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 03:17:30 2022] GET /compute/v2.1/servers/78c535d2-a4ae-43ff-bf93-8c35dfb79876 => generated 1671 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 03:17:30.734176 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [req-4a82030c-f1a1-4edc-acb4-d09fda4d583b req-c19ef21b-246a-48a5-b436-401ac47b08e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78c535d2-a4ae-43ff-bf93-8c35dfb79876", "name": "network-vif-unplugged", "status": "completed", "tag": "0fcb1d19-78cc-466d-b47b-f0891a46de92"}]} {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:17:30.744403 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [req-4a82030c-f1a1-4edc-acb4-d09fda4d583b req-c19ef21b-246a-48a5-b436-401ac47b08e5 service nova] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:30.744869 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [req-4a82030c-f1a1-4edc-acb4-d09fda4d583b req-c19ef21b-246a-48a5-b436-401ac47b08e5 service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:30.745288 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [req-4a82030c-f1a1-4edc-acb4-d09fda4d583b req-c19ef21b-246a-48a5-b436-401ac47b08e5 service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:30.756582 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.compute.server_external_events [req-4a82030c-f1a1-4edc-acb4-d09fda4d583b req-c19ef21b-246a-48a5-b436-401ac47b08e5 service nova] Unable to find a host for instance 78c535d2-a4ae-43ff-bf93-8c35dfb79876. Dropping event network-vif-unplugged {{(pid=118886) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 17 03:17:30.757434 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [req-4a82030c-f1a1-4edc-acb4-d09fda4d583b req-c19ef21b-246a-48a5-b436-401ac47b08e5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.027065 Oct 17 03:17:30.758502 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 402/769] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 03:17:30 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 29 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 17 03:17:31.240306 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-92c9c314-feee-44c4-a08e-2c091712ae53 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:17:31.240908 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-92c9c314-feee-44c4-a08e-2c091712ae53 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: 90f2768b-8259-439c-af06-7eff342615ee] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:17:31.248147 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-92c9c314-feee-44c4-a08e-2c091712ae53 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:31.248625 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-92c9c314-feee-44c4-a08e-2c091712ae53 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:31.249056 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-92c9c314-feee-44c4-a08e-2c091712ae53 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:31.249736 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-92c9c314-feee-44c4-a08e-2c091712ae53 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:31.250188 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-92c9c314-feee-44c4-a08e-2c091712ae53 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:31.250614 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-92c9c314-feee-44c4-a08e-2c091712ae53 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:31.323635 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-c5389931-50cf-4af6-96c9-040962d93114 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:17:31.324465 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-c5389931-50cf-4af6-96c9-040962d93114 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 78c535d2-a4ae-43ff-bf93-8c35dfb79876] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:17:31.330986 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-c5389931-50cf-4af6-96c9-040962d93114 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:31.331475 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-c5389931-50cf-4af6-96c9-040962d93114 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:31.331911 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-c5389931-50cf-4af6-96c9-040962d93114 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:31.332607 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-c5389931-50cf-4af6-96c9-040962d93114 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:31.333059 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-c5389931-50cf-4af6-96c9-040962d93114 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:31.333484 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-c5389931-50cf-4af6-96c9-040962d93114 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:31.380034 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-92c9c314-feee-44c4-a08e-2c091712ae53 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1787a9ef7c44e28076aaa80c0152fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee21a91b84794e80b208fe72b7f1e010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:17:31.388543 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-92c9c314-feee-44c4-a08e-2c091712ae53 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "GET /compute/v2.1/servers/90f2768b-8259-439c-af06-7eff342615ee" status: 200 len: 1522 microversion: 2.1 time: 0.152035 Oct 17 03:17:31.389104 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 368/770] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:17:31 2022] GET /compute/v2.1/servers/90f2768b-8259-439c-af06-7eff342615ee => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:17:31.464170 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-c5389931-50cf-4af6-96c9-040962d93114 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:17:31.472203 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-c5389931-50cf-4af6-96c9-040962d93114 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:17:31.473640 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-c5389931-50cf-4af6-96c9-040962d93114 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:17:31.474776 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-c5389931-50cf-4af6-96c9-040962d93114 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "GET /compute/v2.1/servers/78c535d2-a4ae-43ff-bf93-8c35dfb79876" status: 200 len: 1671 microversion: 2.20 time: 0.155784 Oct 17 03:17:31.475362 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 403/771] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 03:17:31 2022] GET /compute/v2.1/servers/78c535d2-a4ae-43ff-bf93-8c35dfb79876 => generated 1671 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 03:17:32.411704 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-11482f9b-2d42-4aa3-93ec-32c776dfbc68 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:17:32.412359 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-11482f9b-2d42-4aa3-93ec-32c776dfbc68 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: 90f2768b-8259-439c-af06-7eff342615ee] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:17:32.419442 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-11482f9b-2d42-4aa3-93ec-32c776dfbc68 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:32.419960 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-11482f9b-2d42-4aa3-93ec-32c776dfbc68 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:32.420394 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-11482f9b-2d42-4aa3-93ec-32c776dfbc68 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:32.421090 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-11482f9b-2d42-4aa3-93ec-32c776dfbc68 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:32.421546 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-11482f9b-2d42-4aa3-93ec-32c776dfbc68 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:32.421972 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-11482f9b-2d42-4aa3-93ec-32c776dfbc68 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:32.436828 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG dbcounter [-] [118887] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=118887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:17:32.500433 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-34d57d26-41e4-4710-95e3-ba0b7995374e tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:17:32.501039 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-34d57d26-41e4-4710-95e3-ba0b7995374e tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 78c535d2-a4ae-43ff-bf93-8c35dfb79876] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:17:32.507491 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-34d57d26-41e4-4710-95e3-ba0b7995374e tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:32.507974 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-34d57d26-41e4-4710-95e3-ba0b7995374e tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:32.508411 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-34d57d26-41e4-4710-95e3-ba0b7995374e tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:32.509603 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-34d57d26-41e4-4710-95e3-ba0b7995374e tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:32.510056 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-34d57d26-41e4-4710-95e3-ba0b7995374e tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:32.510479 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-34d57d26-41e4-4710-95e3-ba0b7995374e tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:32.557644 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-11482f9b-2d42-4aa3-93ec-32c776dfbc68 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1787a9ef7c44e28076aaa80c0152fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee21a91b84794e80b208fe72b7f1e010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:17:32.565713 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-11482f9b-2d42-4aa3-93ec-32c776dfbc68 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "GET /compute/v2.1/servers/90f2768b-8259-439c-af06-7eff342615ee" status: 200 len: 1522 microversion: 2.1 time: 0.158115 Oct 17 03:17:32.566358 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 369/772] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:17:32 2022] GET /compute/v2.1/servers/90f2768b-8259-439c-af06-7eff342615ee => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:17:32.640464 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-34d57d26-41e4-4710-95e3-ba0b7995374e tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:17:32.648531 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-34d57d26-41e4-4710-95e3-ba0b7995374e tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:17:32.649973 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-34d57d26-41e4-4710-95e3-ba0b7995374e tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:17:32.651132 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-34d57d26-41e4-4710-95e3-ba0b7995374e tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "GET /compute/v2.1/servers/78c535d2-a4ae-43ff-bf93-8c35dfb79876" status: 200 len: 1671 microversion: 2.20 time: 0.154616 Oct 17 03:17:32.651686 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 404/773] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 03:17:32 2022] GET /compute/v2.1/servers/78c535d2-a4ae-43ff-bf93-8c35dfb79876 => generated 1671 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 03:17:32.891979 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-c9e14a44-675f-4656-b405-2cdbd9266c62 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:17:32.892470 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-c9e14a44-675f-4656-b405-2cdbd9266c62 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] [instance: b63b8f22-1f05-418e-b804-010e3d5cd2ae] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:17:32.898442 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-c9e14a44-675f-4656-b405-2cdbd9266c62 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:32.899115 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-c9e14a44-675f-4656-b405-2cdbd9266c62 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:32.899585 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-c9e14a44-675f-4656-b405-2cdbd9266c62 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:32.900445 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-c9e14a44-675f-4656-b405-2cdbd9266c62 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:32.900904 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-c9e14a44-675f-4656-b405-2cdbd9266c62 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:32.901332 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-c9e14a44-675f-4656-b405-2cdbd9266c62 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:32.925859 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-c9e14a44-675f-4656-b405-2cdbd9266c62 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] 10.222.0.27 "GET /compute/v2.1/servers/b63b8f22-1f05-418e-b804-010e3d5cd2ae/ips" status: 200 len: 146 microversion: 2.1 time: 0.085707 Oct 17 03:17:32.926414 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 370/774] 10.222.0.27 () {58 vars in 1248 bytes} [Mon Oct 17 03:17:32 2022] GET /compute/v2.1/servers/b63b8f22-1f05-418e-b804-010e3d5cd2ae/ips => generated 146 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:17:33.591250 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-15a64d66-2383-4865-9dfe-6f54dec43fb5 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:17:33.592587 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-15a64d66-2383-4865-9dfe-6f54dec43fb5 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: 90f2768b-8259-439c-af06-7eff342615ee] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:17:33.594005 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [req-9f30a99b-1f07-4b6d-94c0-e053b2b1452a req-d3060e26-3e69-4b8c-ad27-7cd49e64c7e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90f2768b-8259-439c-af06-7eff342615ee", "name": "network-vif-deleted", "tag": "c31f984d-a48a-493a-8e53-83388b4caabf"}]} {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:17:33.603440 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-15a64d66-2383-4865-9dfe-6f54dec43fb5 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:33.604995 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-15a64d66-2383-4865-9dfe-6f54dec43fb5 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:33.605624 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-15a64d66-2383-4865-9dfe-6f54dec43fb5 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:33.606257 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [req-9f30a99b-1f07-4b6d-94c0-e053b2b1452a req-d3060e26-3e69-4b8c-ad27-7cd49e64c7e8 service nova] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:33.606506 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-15a64d66-2383-4865-9dfe-6f54dec43fb5 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:33.606983 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-15a64d66-2383-4865-9dfe-6f54dec43fb5 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:33.607356 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [req-9f30a99b-1f07-4b6d-94c0-e053b2b1452a req-d3060e26-3e69-4b8c-ad27-7cd49e64c7e8 service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:33.607494 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-15a64d66-2383-4865-9dfe-6f54dec43fb5 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:33.608062 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [req-9f30a99b-1f07-4b6d-94c0-e053b2b1452a req-d3060e26-3e69-4b8c-ad27-7cd49e64c7e8 service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:33.623383 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.compute.server_external_events [req-9f30a99b-1f07-4b6d-94c0-e053b2b1452a req-d3060e26-3e69-4b8c-ad27-7cd49e64c7e8 service nova] Creating event network-vif-deleted:c31f984d-a48a-493a-8e53-83388b4caabf for instance 90f2768b-8259-439c-af06-7eff342615ee on hv-cinder-84697 Oct 17 03:17:33.629815 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [req-9f30a99b-1f07-4b6d-94c0-e053b2b1452a req-d3060e26-3e69-4b8c-ad27-7cd49e64c7e8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040739 Oct 17 03:17:33.632839 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 371/775] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 03:17:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:17:33.678056 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-a380a7af-f04c-4dd6-8672-9ba0e04c57c3 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:17:33.678745 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-a380a7af-f04c-4dd6-8672-9ba0e04c57c3 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 78c535d2-a4ae-43ff-bf93-8c35dfb79876] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:17:33.685567 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-a380a7af-f04c-4dd6-8672-9ba0e04c57c3 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:33.686967 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-a380a7af-f04c-4dd6-8672-9ba0e04c57c3 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:33.687134 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-15a64d66-2383-4865-9dfe-6f54dec43fb5 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1787a9ef7c44e28076aaa80c0152fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee21a91b84794e80b208fe72b7f1e010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:17:33.688115 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-a380a7af-f04c-4dd6-8672-9ba0e04c57c3 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:33.688974 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-a380a7af-f04c-4dd6-8672-9ba0e04c57c3 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:33.689596 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-a380a7af-f04c-4dd6-8672-9ba0e04c57c3 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:33.690158 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-a380a7af-f04c-4dd6-8672-9ba0e04c57c3 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:33.696913 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-15a64d66-2383-4865-9dfe-6f54dec43fb5 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "GET /compute/v2.1/servers/90f2768b-8259-439c-af06-7eff342615ee" status: 200 len: 1480 microversion: 2.1 time: 0.110654 Oct 17 03:17:33.698192 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 405/776] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:17:33 2022] GET /compute/v2.1/servers/90f2768b-8259-439c-af06-7eff342615ee => generated 1480 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:17:33.910675 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-a380a7af-f04c-4dd6-8672-9ba0e04c57c3 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:17:33.919718 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-a380a7af-f04c-4dd6-8672-9ba0e04c57c3 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:17:33.921362 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-a380a7af-f04c-4dd6-8672-9ba0e04c57c3 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:17:33.922705 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-a380a7af-f04c-4dd6-8672-9ba0e04c57c3 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "GET /compute/v2.1/servers/78c535d2-a4ae-43ff-bf93-8c35dfb79876" status: 200 len: 1729 microversion: 2.20 time: 0.249552 Oct 17 03:17:33.923423 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 372/777] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 03:17:33 2022] GET /compute/v2.1/servers/78c535d2-a4ae-43ff-bf93-8c35dfb79876 => generated 1729 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 03:17:34.293438 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-2d9ab417-71f5-4237-a2ee-1a1149dd3d13 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1bebc788-8217-4373-9f5d-fe2113eab24b"}} {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:17:34.295981 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-2d9ab417-71f5-4237-a2ee-1a1149dd3d13 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] [instance: b63b8f22-1f05-418e-b804-010e3d5cd2ae] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:17:34.301803 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-2d9ab417-71f5-4237-a2ee-1a1149dd3d13 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:34.302291 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-2d9ab417-71f5-4237-a2ee-1a1149dd3d13 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:34.302718 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-2d9ab417-71f5-4237-a2ee-1a1149dd3d13 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:34.303449 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-2d9ab417-71f5-4237-a2ee-1a1149dd3d13 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:34.303896 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-2d9ab417-71f5-4237-a2ee-1a1149dd3d13 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:34.304309 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-2d9ab417-71f5-4237-a2ee-1a1149dd3d13 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:34.556879 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-2d9ab417-71f5-4237-a2ee-1a1149dd3d13 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] 10.222.0.27 "POST /compute/v2.1/servers/b63b8f22-1f05-418e-b804-010e3d5cd2ae/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.266373 Oct 17 03:17:34.562416 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 406/778] 10.222.0.27 () {60 vars in 1323 bytes} [Mon Oct 17 03:17:34 2022] POST /compute/v2.1/servers/b63b8f22-1f05-418e-b804-010e3d5cd2ae/os-volume_attachments => generated 194 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:17:34.722330 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-cd19b71c-c151-469a-a2ff-9dddd90b8db8 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:17:34.723008 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-cd19b71c-c151-469a-a2ff-9dddd90b8db8 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] [instance: 90f2768b-8259-439c-af06-7eff342615ee] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:17:34.730484 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-cd19b71c-c151-469a-a2ff-9dddd90b8db8 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:34.731073 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-cd19b71c-c151-469a-a2ff-9dddd90b8db8 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:34.731431 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-cd19b71c-c151-469a-a2ff-9dddd90b8db8 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:34.732279 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-cd19b71c-c151-469a-a2ff-9dddd90b8db8 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:34.732742 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-cd19b71c-c151-469a-a2ff-9dddd90b8db8 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:34.733147 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-cd19b71c-c151-469a-a2ff-9dddd90b8db8 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:34.748439 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.wsgi [None req-cd19b71c-c151-469a-a2ff-9dddd90b8db8 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] HTTP exception thrown: Instance 90f2768b-8259-439c-af06-7eff342615ee could not be found. Oct 17 03:17:34.750296 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-cd19b71c-c151-469a-a2ff-9dddd90b8db8 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Request method failure captured: Oct 17 03:17:34.750296 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: request: GET /compute/v2.1/servers/90f2768b-8259-439c-af06-7eff342615ee HTTP/1.1 Oct 17 03:17:34.750296 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Accept: application/json Oct 17 03:17:34.750296 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Accept-Encoding: identity Oct 17 03:17:34.750296 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Connection: close Oct 17 03:17:34.750296 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Content-Length: 0 Oct 17 03:17:34.750296 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Content-Type: application/json Oct 17 03:17:34.750296 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Host: 10.222.0.27 Oct 17 03:17:34.750296 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Openstack-System-Scope: None Oct 17 03:17:34.750296 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: User-Agent: python-urllib3/1.26.12 Oct 17 03:17:34.750296 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Auth-Token: gAAAAABjTMf8n_6_Hk42-LQ3323zf7rLyhBkZ7TzI7iXmOD1LZOLQulk-a15ge0ewasywiXZ0G3F3f55kCah96aeBj6-Tg6x0QhgUp1XcnGW8u5zIwcRB_iergkiw_PISrGg1NTyyTzxZ2mz7vHEvQ-8c7ZO9C6TeQ_1FzcAq2bYh8NgMR7sjzA Oct 17 03:17:34.750296 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Domain-Id: None Oct 17 03:17:34.750296 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Domain-Name: None Oct 17 03:17:34.750296 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Identity-Status: Confirmed Oct 17 03:17:34.750296 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Is-Admin-Project: True Oct 17 03:17:34.750296 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Project-Domain-Id: default Oct 17 03:17:34.750296 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Project-Domain-Name: Default Oct 17 03:17:34.750296 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Project-Id: ee21a91b84794e80b208fe72b7f1e010 Oct 17 03:17:34.750296 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1171271233 Oct 17 03:17:34.750296 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Role: member,reader Oct 17 03:17:34.750296 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Roles: member,reader Oct 17 03:17:34.752046 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ee21a91b84794e80b208fe72b7f1e010"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ee21a91b84794e80b208fe72b7f1e010"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ee21a91b84794e80b208fe72b7f1e010"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ee21a91b84794e80b208fe72b7f1e010"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 17 03:17:34.752046 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1171271233 Oct 17 03:17:34.752046 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Tenant-Id: ee21a91b84794e80b208fe72b7f1e010 Oct 17 03:17:34.752046 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1171271233 Oct 17 03:17:34.752046 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-User: tempest-ServerRescueNegativeTestJSON-1171271233-project Oct 17 03:17:34.752046 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-User-Domain-Id: default Oct 17 03:17:34.752046 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-User-Domain-Name: Default Oct 17 03:17:34.752046 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-User-Id: 9c1787a9ef7c44e28076aaa80c0152fd Oct 17 03:17:34.752046 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1171271233-project Oct 17 03:17:34.752046 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: method: > Oct 17 03:17:34.752046 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: exception: Instance 90f2768b-8259-439c-af06-7eff342615ee could not be found. Oct 17 03:17:34.752046 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: action_args: {'id': '90f2768b-8259-439c-af06-7eff342615ee'} Oct 17 03:17:34.753345 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 03:17:34.753345 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:17:34.753345 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 03:17:34.753345 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 03:17:34.753345 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 03:17:34.753345 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 03:17:34.753345 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 03:17:34.753345 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 03:17:34.753345 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 03:17:34.753345 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 03:17:34.753345 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90f2768b-8259-439c-af06-7eff342615ee could not be found. Oct 17 03:17:34.753345 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Oct 17 03:17:34.753345 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:17:34.753345 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Oct 17 03:17:34.753345 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:17:34.753345 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:17:34.753345 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:17:34.753345 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 03:17:34.753345 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 03:17:34.753345 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 03:17:34.754787 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 03:17:34.754787 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 03:17:34.754787 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 03:17:34.754787 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 03:17:34.754787 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 03:17:34.754787 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 03:17:34.754787 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 03:17:34.754787 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90f2768b-8259-439c-af06-7eff342615ee could not be found. Oct 17 03:17:34.754787 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Oct 17 03:17:34.754787 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:17:34.754787 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Oct 17 03:17:34.754787 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:17:34.754787 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:17:34.754787 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:17:34.754787 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 03:17:34.754787 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 03:17:34.754787 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90f2768b-8259-439c-af06-7eff342615ee could not be found. Oct 17 03:17:34.754787 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Oct 17 03:17:34.756088 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-cd19b71c-c151-469a-a2ff-9dddd90b8db8 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] Returning 404 to user: Instance 90f2768b-8259-439c-af06-7eff342615ee could not be found. {{(pid=118887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 03:17:34.756088 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-cd19b71c-c151-469a-a2ff-9dddd90b8db8 tempest-ServerRescueNegativeTestJSON-1171271233 tempest-ServerRescueNegativeTestJSON-1171271233-project] 10.222.0.27 "GET /compute/v2.1/servers/90f2768b-8259-439c-af06-7eff342615ee" status: 404 len: 111 microversion: 2.1 time: 0.034873 Oct 17 03:17:34.756881 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 373/779] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:17:34 2022] GET /compute/v2.1/servers/90f2768b-8259-439c-af06-7eff342615ee => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 03:17:34.949361 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-08651430-0a55-4183-8477-ad40849c7a06 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:17:34.951089 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-08651430-0a55-4183-8477-ad40849c7a06 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 78c535d2-a4ae-43ff-bf93-8c35dfb79876] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:17:34.966025 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-08651430-0a55-4183-8477-ad40849c7a06 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:34.966962 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-08651430-0a55-4183-8477-ad40849c7a06 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:34.967770 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-08651430-0a55-4183-8477-ad40849c7a06 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:34.968986 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-08651430-0a55-4183-8477-ad40849c7a06 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:34.969711 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-08651430-0a55-4183-8477-ad40849c7a06 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:34.972721 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-08651430-0a55-4183-8477-ad40849c7a06 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:35.245390 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-08651430-0a55-4183-8477-ad40849c7a06 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:17:35.254064 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-08651430-0a55-4183-8477-ad40849c7a06 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:17:35.259665 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-08651430-0a55-4183-8477-ad40849c7a06 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:17:35.261162 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-08651430-0a55-4183-8477-ad40849c7a06 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "GET /compute/v2.1/servers/78c535d2-a4ae-43ff-bf93-8c35dfb79876" status: 200 len: 1729 microversion: 2.20 time: 0.317179 Oct 17 03:17:35.262374 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 407/780] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 03:17:34 2022] GET /compute/v2.1/servers/78c535d2-a4ae-43ff-bf93-8c35dfb79876 => generated 1729 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:17:36.308997 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-9a2cb0cc-a923-49b3-99c0-487dc05ce26a tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:17:36.309595 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-9a2cb0cc-a923-49b3-99c0-487dc05ce26a tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 78c535d2-a4ae-43ff-bf93-8c35dfb79876] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:17:36.316239 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-9a2cb0cc-a923-49b3-99c0-487dc05ce26a tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:36.316716 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-9a2cb0cc-a923-49b3-99c0-487dc05ce26a tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:36.317140 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-9a2cb0cc-a923-49b3-99c0-487dc05ce26a tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:36.317835 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-9a2cb0cc-a923-49b3-99c0-487dc05ce26a tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:36.318281 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-9a2cb0cc-a923-49b3-99c0-487dc05ce26a tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:36.318697 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-9a2cb0cc-a923-49b3-99c0-487dc05ce26a tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:36.484830 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-9a2cb0cc-a923-49b3-99c0-487dc05ce26a tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:17:36.499285 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-9a2cb0cc-a923-49b3-99c0-487dc05ce26a tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:17:36.501417 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-9a2cb0cc-a923-49b3-99c0-487dc05ce26a tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:17:36.503002 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-9a2cb0cc-a923-49b3-99c0-487dc05ce26a tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "GET /compute/v2.1/servers/78c535d2-a4ae-43ff-bf93-8c35dfb79876" status: 200 len: 1729 microversion: 2.20 time: 0.198759 Oct 17 03:17:36.503754 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 374/781] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 03:17:36 2022] GET /compute/v2.1/servers/78c535d2-a4ae-43ff-bf93-8c35dfb79876 => generated 1729 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:17:37.530132 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-55243bbe-3427-4f55-8a38-c38d864a58f3 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:17:37.532045 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-55243bbe-3427-4f55-8a38-c38d864a58f3 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 78c535d2-a4ae-43ff-bf93-8c35dfb79876] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:17:37.541835 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-55243bbe-3427-4f55-8a38-c38d864a58f3 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:37.542609 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-55243bbe-3427-4f55-8a38-c38d864a58f3 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:37.543107 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-55243bbe-3427-4f55-8a38-c38d864a58f3 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:37.544252 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-55243bbe-3427-4f55-8a38-c38d864a58f3 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:37.545025 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-55243bbe-3427-4f55-8a38-c38d864a58f3 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:37.545729 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-55243bbe-3427-4f55-8a38-c38d864a58f3 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:37.861128 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-55243bbe-3427-4f55-8a38-c38d864a58f3 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:17:37.883294 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-55243bbe-3427-4f55-8a38-c38d864a58f3 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:17:37.886696 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-55243bbe-3427-4f55-8a38-c38d864a58f3 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:17:37.887996 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-55243bbe-3427-4f55-8a38-c38d864a58f3 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "GET /compute/v2.1/servers/78c535d2-a4ae-43ff-bf93-8c35dfb79876" status: 200 len: 1729 microversion: 2.20 time: 0.362775 Oct 17 03:17:37.888550 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 408/782] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 03:17:37 2022] GET /compute/v2.1/servers/78c535d2-a4ae-43ff-bf93-8c35dfb79876 => generated 1729 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:17:38.921298 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-2dd9bf6c-2292-4d7f-bf02-14f1ae855a47 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:17:38.928618 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-2dd9bf6c-2292-4d7f-bf02-14f1ae855a47 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 78c535d2-a4ae-43ff-bf93-8c35dfb79876] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:17:38.942792 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-2dd9bf6c-2292-4d7f-bf02-14f1ae855a47 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:38.945330 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-2dd9bf6c-2292-4d7f-bf02-14f1ae855a47 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:38.945947 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-2dd9bf6c-2292-4d7f-bf02-14f1ae855a47 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:38.949563 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-2dd9bf6c-2292-4d7f-bf02-14f1ae855a47 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:38.950237 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-2dd9bf6c-2292-4d7f-bf02-14f1ae855a47 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:38.950838 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-2dd9bf6c-2292-4d7f-bf02-14f1ae855a47 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:39.155944 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-2dd9bf6c-2292-4d7f-bf02-14f1ae855a47 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:17:39.165824 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-2dd9bf6c-2292-4d7f-bf02-14f1ae855a47 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:17:39.167850 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-2dd9bf6c-2292-4d7f-bf02-14f1ae855a47 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:17:39.169033 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-2dd9bf6c-2292-4d7f-bf02-14f1ae855a47 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "GET /compute/v2.1/servers/78c535d2-a4ae-43ff-bf93-8c35dfb79876" status: 200 len: 1729 microversion: 2.20 time: 0.256099 Oct 17 03:17:39.169758 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 375/783] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 03:17:38 2022] GET /compute/v2.1/servers/78c535d2-a4ae-43ff-bf93-8c35dfb79876 => generated 1729 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:17:40.193934 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-23b81d9b-e5f1-4547-a9b8-6c263aeb708c tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:17:40.195204 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-23b81d9b-e5f1-4547-a9b8-6c263aeb708c tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 78c535d2-a4ae-43ff-bf93-8c35dfb79876] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:17:40.201869 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-23b81d9b-e5f1-4547-a9b8-6c263aeb708c tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:40.202355 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-23b81d9b-e5f1-4547-a9b8-6c263aeb708c tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:40.202797 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-23b81d9b-e5f1-4547-a9b8-6c263aeb708c tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:40.203519 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-23b81d9b-e5f1-4547-a9b8-6c263aeb708c tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:40.203977 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-23b81d9b-e5f1-4547-a9b8-6c263aeb708c tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:40.204399 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-23b81d9b-e5f1-4547-a9b8-6c263aeb708c tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:40.386161 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-23b81d9b-e5f1-4547-a9b8-6c263aeb708c tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:17:40.397109 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-23b81d9b-e5f1-4547-a9b8-6c263aeb708c tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:17:40.398698 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-23b81d9b-e5f1-4547-a9b8-6c263aeb708c tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:17:40.400973 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-23b81d9b-e5f1-4547-a9b8-6c263aeb708c tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "GET /compute/v2.1/servers/78c535d2-a4ae-43ff-bf93-8c35dfb79876" status: 200 len: 1729 microversion: 2.20 time: 0.211007 Oct 17 03:17:40.416159 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 409/784] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 03:17:40 2022] GET /compute/v2.1/servers/78c535d2-a4ae-43ff-bf93-8c35dfb79876 => generated 1729 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:17:41.429743 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-810b16c0-33c8-4519-8834-69d0eb285b43 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:17:41.430524 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-810b16c0-33c8-4519-8834-69d0eb285b43 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 78c535d2-a4ae-43ff-bf93-8c35dfb79876] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:17:41.446987 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-810b16c0-33c8-4519-8834-69d0eb285b43 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:41.447877 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-810b16c0-33c8-4519-8834-69d0eb285b43 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:41.448526 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-810b16c0-33c8-4519-8834-69d0eb285b43 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:41.449458 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-810b16c0-33c8-4519-8834-69d0eb285b43 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:41.450136 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-810b16c0-33c8-4519-8834-69d0eb285b43 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:41.450773 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-810b16c0-33c8-4519-8834-69d0eb285b43 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:41.609624 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-810b16c0-33c8-4519-8834-69d0eb285b43 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:17:41.617849 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-810b16c0-33c8-4519-8834-69d0eb285b43 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:17:41.619908 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-810b16c0-33c8-4519-8834-69d0eb285b43 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:17:41.621039 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-810b16c0-33c8-4519-8834-69d0eb285b43 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "GET /compute/v2.1/servers/78c535d2-a4ae-43ff-bf93-8c35dfb79876" status: 200 len: 1729 microversion: 2.20 time: 0.195817 Oct 17 03:17:41.621592 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 376/785] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 03:17:41 2022] GET /compute/v2.1/servers/78c535d2-a4ae-43ff-bf93-8c35dfb79876 => generated 1729 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:17:42.645633 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-f103fca9-e0fe-4d75-b844-ae27b3a9d62b tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:17:42.646242 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-f103fca9-e0fe-4d75-b844-ae27b3a9d62b tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 78c535d2-a4ae-43ff-bf93-8c35dfb79876] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:17:42.663659 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-f103fca9-e0fe-4d75-b844-ae27b3a9d62b tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:42.664496 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-f103fca9-e0fe-4d75-b844-ae27b3a9d62b tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:42.669410 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-f103fca9-e0fe-4d75-b844-ae27b3a9d62b tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:42.670168 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-f103fca9-e0fe-4d75-b844-ae27b3a9d62b tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:42.670633 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-f103fca9-e0fe-4d75-b844-ae27b3a9d62b tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:42.671294 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-f103fca9-e0fe-4d75-b844-ae27b3a9d62b tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:42.851517 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-f103fca9-e0fe-4d75-b844-ae27b3a9d62b tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:17:42.860929 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-f103fca9-e0fe-4d75-b844-ae27b3a9d62b tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:17:42.862414 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-f103fca9-e0fe-4d75-b844-ae27b3a9d62b tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:17:42.863602 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-f103fca9-e0fe-4d75-b844-ae27b3a9d62b tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "GET /compute/v2.1/servers/78c535d2-a4ae-43ff-bf93-8c35dfb79876" status: 200 len: 1729 microversion: 2.20 time: 0.222022 Oct 17 03:17:42.864163 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 410/786] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 03:17:42 2022] GET /compute/v2.1/servers/78c535d2-a4ae-43ff-bf93-8c35dfb79876 => generated 1729 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:17:43.889929 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-63fab172-06e5-45b1-ae2a-e7be2c92630b tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:17:43.890600 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-63fab172-06e5-45b1-ae2a-e7be2c92630b tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 78c535d2-a4ae-43ff-bf93-8c35dfb79876] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:17:43.897841 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-63fab172-06e5-45b1-ae2a-e7be2c92630b tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:43.898336 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-63fab172-06e5-45b1-ae2a-e7be2c92630b tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:43.898979 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-63fab172-06e5-45b1-ae2a-e7be2c92630b tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:43.899907 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-63fab172-06e5-45b1-ae2a-e7be2c92630b tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:43.900366 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-63fab172-06e5-45b1-ae2a-e7be2c92630b tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:43.900788 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-63fab172-06e5-45b1-ae2a-e7be2c92630b tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:44.058090 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-63fab172-06e5-45b1-ae2a-e7be2c92630b tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:17:44.066607 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-63fab172-06e5-45b1-ae2a-e7be2c92630b tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:17:44.068089 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-63fab172-06e5-45b1-ae2a-e7be2c92630b tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:17:44.069243 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-63fab172-06e5-45b1-ae2a-e7be2c92630b tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "GET /compute/v2.1/servers/78c535d2-a4ae-43ff-bf93-8c35dfb79876" status: 200 len: 1729 microversion: 2.20 time: 0.183478 Oct 17 03:17:44.069795 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 377/787] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 03:17:43 2022] GET /compute/v2.1/servers/78c535d2-a4ae-43ff-bf93-8c35dfb79876 => generated 1729 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:17:45.094254 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-9a40a1a1-d841-4169-b43e-5e592d1efc28 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:17:45.094908 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-9a40a1a1-d841-4169-b43e-5e592d1efc28 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 78c535d2-a4ae-43ff-bf93-8c35dfb79876] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:17:45.101283 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-9a40a1a1-d841-4169-b43e-5e592d1efc28 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:45.101752 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-9a40a1a1-d841-4169-b43e-5e592d1efc28 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:45.102182 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-9a40a1a1-d841-4169-b43e-5e592d1efc28 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:45.103424 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-9a40a1a1-d841-4169-b43e-5e592d1efc28 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:45.103874 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-9a40a1a1-d841-4169-b43e-5e592d1efc28 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:45.104291 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-9a40a1a1-d841-4169-b43e-5e592d1efc28 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:45.229489 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-9a40a1a1-d841-4169-b43e-5e592d1efc28 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:17:45.237744 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-9a40a1a1-d841-4169-b43e-5e592d1efc28 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:17:45.239201 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-9a40a1a1-d841-4169-b43e-5e592d1efc28 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:17:45.240333 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-9a40a1a1-d841-4169-b43e-5e592d1efc28 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "GET /compute/v2.1/servers/78c535d2-a4ae-43ff-bf93-8c35dfb79876" status: 200 len: 1729 microversion: 2.20 time: 0.149998 Oct 17 03:17:45.240883 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 411/788] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 03:17:45 2022] GET /compute/v2.1/servers/78c535d2-a4ae-43ff-bf93-8c35dfb79876 => generated 1729 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:17:46.266009 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-37520b06-a2b4-482d-a64f-e006a0923213 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:17:46.266616 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-37520b06-a2b4-482d-a64f-e006a0923213 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 78c535d2-a4ae-43ff-bf93-8c35dfb79876] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:17:46.273191 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-37520b06-a2b4-482d-a64f-e006a0923213 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:46.273676 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-37520b06-a2b4-482d-a64f-e006a0923213 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:46.274115 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-37520b06-a2b4-482d-a64f-e006a0923213 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:46.275643 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-37520b06-a2b4-482d-a64f-e006a0923213 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:46.276108 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-37520b06-a2b4-482d-a64f-e006a0923213 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:46.276540 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-37520b06-a2b4-482d-a64f-e006a0923213 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:46.406511 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-37520b06-a2b4-482d-a64f-e006a0923213 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:17:46.416447 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-37520b06-a2b4-482d-a64f-e006a0923213 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:17:46.418024 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-37520b06-a2b4-482d-a64f-e006a0923213 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:17:46.419239 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-37520b06-a2b4-482d-a64f-e006a0923213 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "GET /compute/v2.1/servers/78c535d2-a4ae-43ff-bf93-8c35dfb79876" status: 200 len: 1729 microversion: 2.20 time: 0.157179 Oct 17 03:17:46.419781 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 378/789] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 03:17:46 2022] GET /compute/v2.1/servers/78c535d2-a4ae-43ff-bf93-8c35dfb79876 => generated 1729 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:17:47.445543 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-e5bae753-47b7-488a-ac21-d351362770d5 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:17:47.446078 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-e5bae753-47b7-488a-ac21-d351362770d5 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 78c535d2-a4ae-43ff-bf93-8c35dfb79876] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:17:47.453022 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-e5bae753-47b7-488a-ac21-d351362770d5 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:47.453520 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-e5bae753-47b7-488a-ac21-d351362770d5 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:47.453930 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-e5bae753-47b7-488a-ac21-d351362770d5 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:47.454626 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-e5bae753-47b7-488a-ac21-d351362770d5 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:47.455099 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-e5bae753-47b7-488a-ac21-d351362770d5 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:47.455519 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-e5bae753-47b7-488a-ac21-d351362770d5 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:47.581359 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-e5bae753-47b7-488a-ac21-d351362770d5 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:17:47.589871 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-e5bae753-47b7-488a-ac21-d351362770d5 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:17:47.591315 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-e5bae753-47b7-488a-ac21-d351362770d5 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:17:47.592799 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-e5bae753-47b7-488a-ac21-d351362770d5 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "GET /compute/v2.1/servers/78c535d2-a4ae-43ff-bf93-8c35dfb79876" status: 200 len: 1729 microversion: 2.20 time: 0.151172 Oct 17 03:17:47.593304 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 412/790] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 03:17:47 2022] GET /compute/v2.1/servers/78c535d2-a4ae-43ff-bf93-8c35dfb79876 => generated 1729 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:17:48.619163 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-2e2f6f3c-f336-4657-9f8e-d397d81af075 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:17:48.619813 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-2e2f6f3c-f336-4657-9f8e-d397d81af075 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 78c535d2-a4ae-43ff-bf93-8c35dfb79876] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:17:48.626254 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-2e2f6f3c-f336-4657-9f8e-d397d81af075 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:48.626732 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-2e2f6f3c-f336-4657-9f8e-d397d81af075 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:48.627195 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-2e2f6f3c-f336-4657-9f8e-d397d81af075 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:48.627884 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-2e2f6f3c-f336-4657-9f8e-d397d81af075 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:48.628332 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-2e2f6f3c-f336-4657-9f8e-d397d81af075 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:48.628757 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-2e2f6f3c-f336-4657-9f8e-d397d81af075 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:48.763774 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-2e2f6f3c-f336-4657-9f8e-d397d81af075 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:17:48.772193 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-2e2f6f3c-f336-4657-9f8e-d397d81af075 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:17:48.773617 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-2e2f6f3c-f336-4657-9f8e-d397d81af075 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:17:48.774897 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-2e2f6f3c-f336-4657-9f8e-d397d81af075 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "GET /compute/v2.1/servers/78c535d2-a4ae-43ff-bf93-8c35dfb79876" status: 200 len: 1729 microversion: 2.20 time: 0.160266 Oct 17 03:17:48.775440 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 379/791] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 03:17:48 2022] GET /compute/v2.1/servers/78c535d2-a4ae-43ff-bf93-8c35dfb79876 => generated 1729 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:17:49.800329 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-d6309857-bdf8-4220-a26c-6003d88e3cf8 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:17:49.800958 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-d6309857-bdf8-4220-a26c-6003d88e3cf8 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 78c535d2-a4ae-43ff-bf93-8c35dfb79876] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:17:49.808113 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-d6309857-bdf8-4220-a26c-6003d88e3cf8 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:49.808585 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-d6309857-bdf8-4220-a26c-6003d88e3cf8 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:49.809007 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-d6309857-bdf8-4220-a26c-6003d88e3cf8 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:49.809686 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-d6309857-bdf8-4220-a26c-6003d88e3cf8 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:49.810127 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-d6309857-bdf8-4220-a26c-6003d88e3cf8 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:49.810540 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-d6309857-bdf8-4220-a26c-6003d88e3cf8 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:49.939265 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-d6309857-bdf8-4220-a26c-6003d88e3cf8 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:17:49.947389 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-d6309857-bdf8-4220-a26c-6003d88e3cf8 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:17:49.948838 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-d6309857-bdf8-4220-a26c-6003d88e3cf8 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:17:49.949976 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-d6309857-bdf8-4220-a26c-6003d88e3cf8 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "GET /compute/v2.1/servers/78c535d2-a4ae-43ff-bf93-8c35dfb79876" status: 200 len: 1729 microversion: 2.20 time: 0.153514 Oct 17 03:17:49.950532 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 413/792] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 03:17:49 2022] GET /compute/v2.1/servers/78c535d2-a4ae-43ff-bf93-8c35dfb79876 => generated 1729 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:17:50.975665 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-abd427fb-ea7e-4ab4-8b34-4de2d316a585 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:17:50.976268 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-abd427fb-ea7e-4ab4-8b34-4de2d316a585 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 78c535d2-a4ae-43ff-bf93-8c35dfb79876] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:17:50.983228 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-abd427fb-ea7e-4ab4-8b34-4de2d316a585 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:50.983709 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-abd427fb-ea7e-4ab4-8b34-4de2d316a585 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:50.984141 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-abd427fb-ea7e-4ab4-8b34-4de2d316a585 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:50.984825 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-abd427fb-ea7e-4ab4-8b34-4de2d316a585 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:50.985272 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-abd427fb-ea7e-4ab4-8b34-4de2d316a585 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:50.985693 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-abd427fb-ea7e-4ab4-8b34-4de2d316a585 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:51.117311 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-abd427fb-ea7e-4ab4-8b34-4de2d316a585 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:17:51.126038 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-abd427fb-ea7e-4ab4-8b34-4de2d316a585 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:17:51.127537 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-abd427fb-ea7e-4ab4-8b34-4de2d316a585 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:17:51.128703 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-abd427fb-ea7e-4ab4-8b34-4de2d316a585 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "GET /compute/v2.1/servers/78c535d2-a4ae-43ff-bf93-8c35dfb79876" status: 200 len: 1729 microversion: 2.20 time: 0.156985 Oct 17 03:17:51.129277 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 380/793] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 03:17:50 2022] GET /compute/v2.1/servers/78c535d2-a4ae-43ff-bf93-8c35dfb79876 => generated 1729 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:17:52.155193 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-74e91ff2-eb2f-46c4-99c9-4232573f6242 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:17:52.156059 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-74e91ff2-eb2f-46c4-99c9-4232573f6242 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 78c535d2-a4ae-43ff-bf93-8c35dfb79876] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:17:52.163272 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-74e91ff2-eb2f-46c4-99c9-4232573f6242 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:52.163765 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-74e91ff2-eb2f-46c4-99c9-4232573f6242 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:52.164203 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-74e91ff2-eb2f-46c4-99c9-4232573f6242 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:52.166065 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-74e91ff2-eb2f-46c4-99c9-4232573f6242 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:52.166262 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-74e91ff2-eb2f-46c4-99c9-4232573f6242 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:52.166832 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-74e91ff2-eb2f-46c4-99c9-4232573f6242 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:52.308494 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-74e91ff2-eb2f-46c4-99c9-4232573f6242 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:17:52.316753 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-74e91ff2-eb2f-46c4-99c9-4232573f6242 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:17:52.318189 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-74e91ff2-eb2f-46c4-99c9-4232573f6242 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:17:52.319353 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-74e91ff2-eb2f-46c4-99c9-4232573f6242 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "GET /compute/v2.1/servers/78c535d2-a4ae-43ff-bf93-8c35dfb79876" status: 200 len: 1729 microversion: 2.20 time: 0.168732 Oct 17 03:17:52.319912 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 414/794] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 03:17:52 2022] GET /compute/v2.1/servers/78c535d2-a4ae-43ff-bf93-8c35dfb79876 => generated 1729 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:17:52.987633 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [req-8c4a9e98-6c68-4c99-8ee7-86d6a2e0efa1 req-c8cc7e50-bd4f-44c9-90b7-43c4f386b443 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78c535d2-a4ae-43ff-bf93-8c35dfb79876", "name": "network-vif-plugged", "status": "completed", "tag": "0fcb1d19-78cc-466d-b47b-f0891a46de92"}]} {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:17:52.998512 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [req-8c4a9e98-6c68-4c99-8ee7-86d6a2e0efa1 req-c8cc7e50-bd4f-44c9-90b7-43c4f386b443 service nova] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:52.999027 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [req-8c4a9e98-6c68-4c99-8ee7-86d6a2e0efa1 req-c8cc7e50-bd4f-44c9-90b7-43c4f386b443 service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:52.999450 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [req-8c4a9e98-6c68-4c99-8ee7-86d6a2e0efa1 req-c8cc7e50-bd4f-44c9-90b7-43c4f386b443 service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:53.012380 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.compute.server_external_events [req-8c4a9e98-6c68-4c99-8ee7-86d6a2e0efa1 req-c8cc7e50-bd4f-44c9-90b7-43c4f386b443 service nova] Creating event network-vif-plugged:0fcb1d19-78cc-466d-b47b-f0891a46de92 for instance 78c535d2-a4ae-43ff-bf93-8c35dfb79876 on hv-cinder-84697 Oct 17 03:17:53.017881 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [req-8c4a9e98-6c68-4c99-8ee7-86d6a2e0efa1 req-c8cc7e50-bd4f-44c9-90b7-43c4f386b443 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.164221 Oct 17 03:17:53.018477 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 381/795] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 03:17:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:17:53.345422 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-994583d7-66fb-4cf1-acdc-6b258b314888 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:17:53.346030 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-994583d7-66fb-4cf1-acdc-6b258b314888 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 78c535d2-a4ae-43ff-bf93-8c35dfb79876] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:17:53.352142 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-994583d7-66fb-4cf1-acdc-6b258b314888 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:53.353598 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-994583d7-66fb-4cf1-acdc-6b258b314888 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:53.354046 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-994583d7-66fb-4cf1-acdc-6b258b314888 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:53.354738 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-994583d7-66fb-4cf1-acdc-6b258b314888 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:53.355217 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-994583d7-66fb-4cf1-acdc-6b258b314888 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:53.355642 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-994583d7-66fb-4cf1-acdc-6b258b314888 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:53.507568 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-994583d7-66fb-4cf1-acdc-6b258b314888 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:17:53.519446 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-994583d7-66fb-4cf1-acdc-6b258b314888 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:17:53.522462 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-994583d7-66fb-4cf1-acdc-6b258b314888 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:17:53.524161 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-994583d7-66fb-4cf1-acdc-6b258b314888 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "GET /compute/v2.1/servers/78c535d2-a4ae-43ff-bf93-8c35dfb79876" status: 200 len: 1729 microversion: 2.20 time: 0.182447 Oct 17 03:17:53.526179 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 415/796] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 03:17:53 2022] GET /compute/v2.1/servers/78c535d2-a4ae-43ff-bf93-8c35dfb79876 => generated 1729 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:17:54.552655 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-848f2e16-ef92-4c6e-824b-35b32a790558 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:17:54.553350 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-848f2e16-ef92-4c6e-824b-35b32a790558 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 78c535d2-a4ae-43ff-bf93-8c35dfb79876] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:17:54.559373 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-848f2e16-ef92-4c6e-824b-35b32a790558 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:54.559848 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-848f2e16-ef92-4c6e-824b-35b32a790558 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:54.560277 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-848f2e16-ef92-4c6e-824b-35b32a790558 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:54.560957 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-848f2e16-ef92-4c6e-824b-35b32a790558 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:54.561402 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-848f2e16-ef92-4c6e-824b-35b32a790558 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:54.561819 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-848f2e16-ef92-4c6e-824b-35b32a790558 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:54.691995 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-848f2e16-ef92-4c6e-824b-35b32a790558 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:17:54.700004 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-848f2e16-ef92-4c6e-824b-35b32a790558 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:17:54.701419 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-848f2e16-ef92-4c6e-824b-35b32a790558 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:17:54.702552 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-848f2e16-ef92-4c6e-824b-35b32a790558 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "GET /compute/v2.1/servers/78c535d2-a4ae-43ff-bf93-8c35dfb79876" status: 200 len: 1729 microversion: 2.20 time: 0.154797 Oct 17 03:17:54.703141 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 382/797] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 03:17:54 2022] GET /compute/v2.1/servers/78c535d2-a4ae-43ff-bf93-8c35dfb79876 => generated 1729 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:17:55.002248 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-75ed3654-8d9d-4c82-bbf3-a7c78f3c7e2c tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:17:55.004542 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-75ed3654-8d9d-4c82-bbf3-a7c78f3c7e2c tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] [instance: b63b8f22-1f05-418e-b804-010e3d5cd2ae] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:17:55.011968 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-75ed3654-8d9d-4c82-bbf3-a7c78f3c7e2c tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:55.012452 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-75ed3654-8d9d-4c82-bbf3-a7c78f3c7e2c tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:55.012882 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-75ed3654-8d9d-4c82-bbf3-a7c78f3c7e2c tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:55.013575 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-75ed3654-8d9d-4c82-bbf3-a7c78f3c7e2c tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:55.014042 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-75ed3654-8d9d-4c82-bbf3-a7c78f3c7e2c tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:55.014466 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-75ed3654-8d9d-4c82-bbf3-a7c78f3c7e2c tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:55.018421 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG dbcounter [-] [118886] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=118886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:17:55.046912 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-75ed3654-8d9d-4c82-bbf3-a7c78f3c7e2c tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] 10.222.0.27 "GET /compute/v2.1/servers/b63b8f22-1f05-418e-b804-010e3d5cd2ae/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048545 Oct 17 03:17:55.047485 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 416/798] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 17 03:17:54 2022] GET /compute/v2.1/servers/b63b8f22-1f05-418e-b804-010e3d5cd2ae/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:17:55.058396 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-434ea13d-629d-44ef-aa84-6e343dd372e5 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:17:55.058914 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-434ea13d-629d-44ef-aa84-6e343dd372e5 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] [instance: b63b8f22-1f05-418e-b804-010e3d5cd2ae] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:17:55.064715 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-434ea13d-629d-44ef-aa84-6e343dd372e5 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:55.065198 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-434ea13d-629d-44ef-aa84-6e343dd372e5 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:55.065640 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-434ea13d-629d-44ef-aa84-6e343dd372e5 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:55.066330 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-434ea13d-629d-44ef-aa84-6e343dd372e5 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:55.066785 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-434ea13d-629d-44ef-aa84-6e343dd372e5 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:55.067363 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-434ea13d-629d-44ef-aa84-6e343dd372e5 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:55.096987 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-434ea13d-629d-44ef-aa84-6e343dd372e5 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] 10.222.0.27 "GET /compute/v2.1/servers/b63b8f22-1f05-418e-b804-010e3d5cd2ae/os-volume_attachments/1bebc788-8217-4373-9f5d-fe2113eab24b" status: 200 len: 194 microversion: 2.1 time: 0.042505 Oct 17 03:17:55.097739 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 383/799] 10.222.0.27 () {58 vars in 1413 bytes} [Mon Oct 17 03:17:55 2022] GET /compute/v2.1/servers/b63b8f22-1f05-418e-b804-010e3d5cd2ae/os-volume_attachments/1bebc788-8217-4373-9f5d-fe2113eab24b => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:17:55.344218 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-904f69d8-6d20-4b36-b36b-4f0f3abfb217 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:17:55.344703 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-904f69d8-6d20-4b36-b36b-4f0f3abfb217 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] [instance: 87c4c474-a5ab-4532-bffa-5b3d2cb15d55] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:17:55.351628 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-904f69d8-6d20-4b36-b36b-4f0f3abfb217 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:55.352110 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-904f69d8-6d20-4b36-b36b-4f0f3abfb217 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:55.353444 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-904f69d8-6d20-4b36-b36b-4f0f3abfb217 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:55.354596 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-904f69d8-6d20-4b36-b36b-4f0f3abfb217 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:55.355375 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-904f69d8-6d20-4b36-b36b-4f0f3abfb217 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:55.355945 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-904f69d8-6d20-4b36-b36b-4f0f3abfb217 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:55.423989 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-904f69d8-6d20-4b36-b36b-4f0f3abfb217 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] 10.222.0.27 "GET /compute/v2.1/servers/87c4c474-a5ab-4532-bffa-5b3d2cb15d55/ips" status: 200 len: 150 microversion: 2.1 time: 0.083952 Oct 17 03:17:55.424615 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 417/800] 10.222.0.27 () {58 vars in 1248 bytes} [Mon Oct 17 03:17:55 2022] GET /compute/v2.1/servers/87c4c474-a5ab-4532-bffa-5b3d2cb15d55/ips => generated 150 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:17:55.736928 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-3a33f7a9-ef83-4460-8f9c-7ba2202652cc tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:17:55.739992 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-3a33f7a9-ef83-4460-8f9c-7ba2202652cc tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 78c535d2-a4ae-43ff-bf93-8c35dfb79876] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:17:55.748031 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-3a33f7a9-ef83-4460-8f9c-7ba2202652cc tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:55.748918 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-3a33f7a9-ef83-4460-8f9c-7ba2202652cc tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:55.749596 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-3a33f7a9-ef83-4460-8f9c-7ba2202652cc tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:55.750586 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-3a33f7a9-ef83-4460-8f9c-7ba2202652cc tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:55.751432 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-3a33f7a9-ef83-4460-8f9c-7ba2202652cc tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:55.752136 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-3a33f7a9-ef83-4460-8f9c-7ba2202652cc tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:55.921742 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-3a33f7a9-ef83-4460-8f9c-7ba2202652cc tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:17:55.931212 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-3a33f7a9-ef83-4460-8f9c-7ba2202652cc tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:17:55.933231 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-3a33f7a9-ef83-4460-8f9c-7ba2202652cc tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:17:55.935409 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-3a33f7a9-ef83-4460-8f9c-7ba2202652cc tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "GET /compute/v2.1/servers/78c535d2-a4ae-43ff-bf93-8c35dfb79876" status: 200 len: 1729 microversion: 2.20 time: 0.210701 Oct 17 03:17:55.936743 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 384/801] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 03:17:55 2022] GET /compute/v2.1/servers/78c535d2-a4ae-43ff-bf93-8c35dfb79876 => generated 1729 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:17:56.530354 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-2e105765-b5b0-46ff-8220-7692a8293191 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "482be4ca-49da-42da-8a54-69655a17d19e"}} {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:17:56.532803 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-2e105765-b5b0-46ff-8220-7692a8293191 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] [instance: b63b8f22-1f05-418e-b804-010e3d5cd2ae] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:17:56.539362 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-2e105765-b5b0-46ff-8220-7692a8293191 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:56.539846 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-2e105765-b5b0-46ff-8220-7692a8293191 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:56.540373 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-2e105765-b5b0-46ff-8220-7692a8293191 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:56.541066 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-2e105765-b5b0-46ff-8220-7692a8293191 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:56.541516 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-2e105765-b5b0-46ff-8220-7692a8293191 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:56.541940 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-2e105765-b5b0-46ff-8220-7692a8293191 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:56.778405 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-2e105765-b5b0-46ff-8220-7692a8293191 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] 10.222.0.27 "POST /compute/v2.1/servers/b63b8f22-1f05-418e-b804-010e3d5cd2ae/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.251757 Oct 17 03:17:56.779300 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 418/802] 10.222.0.27 () {60 vars in 1323 bytes} [Mon Oct 17 03:17:56 2022] POST /compute/v2.1/servers/b63b8f22-1f05-418e-b804-010e3d5cd2ae/os-volume_attachments => generated 194 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 03:17:56.961995 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-fc674654-98ef-4893-b677-80f6b171ed4a tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:17:56.962693 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-fc674654-98ef-4893-b677-80f6b171ed4a tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 78c535d2-a4ae-43ff-bf93-8c35dfb79876] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:17:56.969259 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-fc674654-98ef-4893-b677-80f6b171ed4a tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:56.969770 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-fc674654-98ef-4893-b677-80f6b171ed4a tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:56.970192 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-fc674654-98ef-4893-b677-80f6b171ed4a tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:56.970895 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-fc674654-98ef-4893-b677-80f6b171ed4a tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:56.971341 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-fc674654-98ef-4893-b677-80f6b171ed4a tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:56.971762 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-fc674654-98ef-4893-b677-80f6b171ed4a tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:56.980355 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-ec7a8481-7e67-46a1-8599-8e148648084d tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8ce159a3-b274-4209-89fb-7c8f25b48a51"}} {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:17:56.982739 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-ec7a8481-7e67-46a1-8599-8e148648084d tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] [instance: 87c4c474-a5ab-4532-bffa-5b3d2cb15d55] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:17:56.985117 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG dbcounter [-] [118886] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1 {{(pid=118886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:17:56.991119 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-ec7a8481-7e67-46a1-8599-8e148648084d tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:56.991564 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-ec7a8481-7e67-46a1-8599-8e148648084d tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:56.992002 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-ec7a8481-7e67-46a1-8599-8e148648084d tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:56.992755 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-ec7a8481-7e67-46a1-8599-8e148648084d tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:17:56.993822 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-ec7a8481-7e67-46a1-8599-8e148648084d tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:17:56.994267 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-ec7a8481-7e67-46a1-8599-8e148648084d tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:17:57.116813 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-fc674654-98ef-4893-b677-80f6b171ed4a tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:17:57.127180 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-fc674654-98ef-4893-b677-80f6b171ed4a tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:17:57.128509 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-fc674654-98ef-4893-b677-80f6b171ed4a tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:17:57.129768 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-fc674654-98ef-4893-b677-80f6b171ed4a tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "GET /compute/v2.1/servers/78c535d2-a4ae-43ff-bf93-8c35dfb79876" status: 200 len: 1716 microversion: 2.20 time: 0.171736 Oct 17 03:17:57.142927 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 385/803] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 03:17:56 2022] GET /compute/v2.1/servers/78c535d2-a4ae-43ff-bf93-8c35dfb79876 => generated 1716 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:17:57.272492 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-ec7a8481-7e67-46a1-8599-8e148648084d tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] 10.222.0.27 "POST /compute/v2.1/servers/87c4c474-a5ab-4532-bffa-5b3d2cb15d55/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.296602 Oct 17 03:17:57.273173 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 419/804] 10.222.0.27 () {60 vars in 1323 bytes} [Mon Oct 17 03:17:56 2022] POST /compute/v2.1/servers/87c4c474-a5ab-4532-bffa-5b3d2cb15d55/os-volume_attachments => generated 194 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 03:18:04.323162 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-3b76f1f6-7370-47c8-b26c-20779b010644 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:18:04.325573 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-3b76f1f6-7370-47c8-b26c-20779b010644 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] [instance: b63b8f22-1f05-418e-b804-010e3d5cd2ae] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:18:04.328144 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG dbcounter [-] [118887] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1 {{(pid=118887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:18:04.334125 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-3b76f1f6-7370-47c8-b26c-20779b010644 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:18:04.334614 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-3b76f1f6-7370-47c8-b26c-20779b010644 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:18:04.335085 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-3b76f1f6-7370-47c8-b26c-20779b010644 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:18:04.335817 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-3b76f1f6-7370-47c8-b26c-20779b010644 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:18:04.336276 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-3b76f1f6-7370-47c8-b26c-20779b010644 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:18:04.337201 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-3b76f1f6-7370-47c8-b26c-20779b010644 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:18:04.340806 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG dbcounter [-] [118887] Writing DB stats nova_cell1:SELECT=86 {{(pid=118887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:18:04.370014 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-3b76f1f6-7370-47c8-b26c-20779b010644 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] 10.222.0.27 "GET /compute/v2.1/servers/b63b8f22-1f05-418e-b804-010e3d5cd2ae/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.050812 Oct 17 03:18:04.370938 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 386/805] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 17 03:18:04 2022] GET /compute/v2.1/servers/b63b8f22-1f05-418e-b804-010e3d5cd2ae/os-volume_attachments => generated 371 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:18:04.511489 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-95ae5d9a-e91d-48d5-9d87-97c9a558e8c9 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:18:04.512058 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-95ae5d9a-e91d-48d5-9d87-97c9a558e8c9 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] [instance: b63b8f22-1f05-418e-b804-010e3d5cd2ae] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:18:04.518811 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-95ae5d9a-e91d-48d5-9d87-97c9a558e8c9 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:18:04.519319 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-95ae5d9a-e91d-48d5-9d87-97c9a558e8c9 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:18:04.519747 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-95ae5d9a-e91d-48d5-9d87-97c9a558e8c9 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:18:04.520430 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-95ae5d9a-e91d-48d5-9d87-97c9a558e8c9 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:18:04.520876 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-95ae5d9a-e91d-48d5-9d87-97c9a558e8c9 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:18:04.521300 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-95ae5d9a-e91d-48d5-9d87-97c9a558e8c9 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:18:04.551550 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-95ae5d9a-e91d-48d5-9d87-97c9a558e8c9 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] 10.222.0.27 "GET /compute/v2.1/servers/b63b8f22-1f05-418e-b804-010e3d5cd2ae/os-volume_attachments/1bebc788-8217-4373-9f5d-fe2113eab24b" status: 200 len: 194 microversion: 2.1 time: 0.044936 Oct 17 03:18:04.552146 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 420/806] 10.222.0.27 () {58 vars in 1413 bytes} [Mon Oct 17 03:18:04 2022] GET /compute/v2.1/servers/b63b8f22-1f05-418e-b804-010e3d5cd2ae/os-volume_attachments/1bebc788-8217-4373-9f5d-fe2113eab24b => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:18:04.562511 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-9bb37999-c0bf-4c20-8760-599aa8f30fdc tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:18:04.563038 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-9bb37999-c0bf-4c20-8760-599aa8f30fdc tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] [instance: b63b8f22-1f05-418e-b804-010e3d5cd2ae] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:18:04.569127 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-9bb37999-c0bf-4c20-8760-599aa8f30fdc tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:18:04.569712 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-9bb37999-c0bf-4c20-8760-599aa8f30fdc tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:18:04.570229 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-9bb37999-c0bf-4c20-8760-599aa8f30fdc tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:18:04.571471 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-9bb37999-c0bf-4c20-8760-599aa8f30fdc tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:18:04.572058 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-9bb37999-c0bf-4c20-8760-599aa8f30fdc tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:18:04.572489 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-9bb37999-c0bf-4c20-8760-599aa8f30fdc tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:18:04.661263 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.objects.instance [None req-9bb37999-c0bf-4c20-8760-599aa8f30fdc tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lazy-loading 'services' on Instance uuid b63b8f22-1f05-418e-b804-010e3d5cd2ae {{(pid=118887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 03:18:04.737091 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-9bb37999-c0bf-4c20-8760-599aa8f30fdc tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] 10.222.0.27 "DELETE /compute/v2.1/servers/b63b8f22-1f05-418e-b804-010e3d5cd2ae/os-volume_attachments/1bebc788-8217-4373-9f5d-fe2113eab24b" status: 202 len: 0 microversion: 2.1 time: 0.178300 Oct 17 03:18:04.737681 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 387/807] 10.222.0.27 () {58 vars in 1416 bytes} [Mon Oct 17 03:18:04 2022] DELETE /compute/v2.1/servers/b63b8f22-1f05-418e-b804-010e3d5cd2ae/os-volume_attachments/1bebc788-8217-4373-9f5d-fe2113eab24b => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 03:18:10.261258 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-c083d6ab-2038-431c-b34a-bec8d268adb6 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:18:10.261764 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-c083d6ab-2038-431c-b34a-bec8d268adb6 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] [instance: 87c4c474-a5ab-4532-bffa-5b3d2cb15d55] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:18:10.268280 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-c083d6ab-2038-431c-b34a-bec8d268adb6 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:18:10.268760 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-c083d6ab-2038-431c-b34a-bec8d268adb6 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:18:10.269193 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-c083d6ab-2038-431c-b34a-bec8d268adb6 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:18:10.269884 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-c083d6ab-2038-431c-b34a-bec8d268adb6 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:18:10.270338 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-c083d6ab-2038-431c-b34a-bec8d268adb6 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:18:10.270780 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-c083d6ab-2038-431c-b34a-bec8d268adb6 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:18:10.366605 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.objects.instance [None req-c083d6ab-2038-431c-b34a-bec8d268adb6 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lazy-loading 'services' on Instance uuid 87c4c474-a5ab-4532-bffa-5b3d2cb15d55 {{(pid=118886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 03:18:10.440011 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-c083d6ab-2038-431c-b34a-bec8d268adb6 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] 10.222.0.27 "DELETE /compute/v2.1/servers/87c4c474-a5ab-4532-bffa-5b3d2cb15d55/os-volume_attachments/8ce159a3-b274-4209-89fb-7c8f25b48a51" status: 202 len: 0 microversion: 2.1 time: 0.183124 Oct 17 03:18:10.440608 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 421/808] 10.222.0.27 () {58 vars in 1416 bytes} [Mon Oct 17 03:18:10 2022] DELETE /compute/v2.1/servers/87c4c474-a5ab-4532-bffa-5b3d2cb15d55/os-volume_attachments/8ce159a3-b274-4209-89fb-7c8f25b48a51 => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 03:18:10.451139 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-9c53dfb8-d8fb-4b31-b542-9a4505f86a8c tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:18:10.454234 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-9c53dfb8-d8fb-4b31-b542-9a4505f86a8c tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] [instance: 87c4c474-a5ab-4532-bffa-5b3d2cb15d55] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:18:10.463695 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-9c53dfb8-d8fb-4b31-b542-9a4505f86a8c tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:18:10.464368 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-9c53dfb8-d8fb-4b31-b542-9a4505f86a8c tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:18:10.464980 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-9c53dfb8-d8fb-4b31-b542-9a4505f86a8c tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:18:10.465693 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-9c53dfb8-d8fb-4b31-b542-9a4505f86a8c tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:18:10.466126 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-9c53dfb8-d8fb-4b31-b542-9a4505f86a8c tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:18:10.466711 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-9c53dfb8-d8fb-4b31-b542-9a4505f86a8c tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:18:10.523392 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-9c53dfb8-d8fb-4b31-b542-9a4505f86a8c tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] 10.222.0.27 "GET /compute/v2.1/servers/87c4c474-a5ab-4532-bffa-5b3d2cb15d55/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078059 Oct 17 03:18:10.524258 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 388/809] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 17 03:18:10 2022] GET /compute/v2.1/servers/87c4c474-a5ab-4532-bffa-5b3d2cb15d55/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:18:11.190794 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-cd3bc4e3-3b41-454c-9b7f-60e4984f1b5b tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:18:11.191386 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-cd3bc4e3-3b41-454c-9b7f-60e4984f1b5b tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] [instance: b63b8f22-1f05-418e-b804-010e3d5cd2ae] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:18:11.197858 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-cd3bc4e3-3b41-454c-9b7f-60e4984f1b5b tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:18:11.198602 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-cd3bc4e3-3b41-454c-9b7f-60e4984f1b5b tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:18:11.199210 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-cd3bc4e3-3b41-454c-9b7f-60e4984f1b5b tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:18:11.200048 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-cd3bc4e3-3b41-454c-9b7f-60e4984f1b5b tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:18:11.200704 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-cd3bc4e3-3b41-454c-9b7f-60e4984f1b5b tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:18:11.201456 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-cd3bc4e3-3b41-454c-9b7f-60e4984f1b5b tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:18:11.235441 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-cd3bc4e3-3b41-454c-9b7f-60e4984f1b5b tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] 10.222.0.27 "GET /compute/v2.1/servers/b63b8f22-1f05-418e-b804-010e3d5cd2ae/os-volume_attachments/482be4ca-49da-42da-8a54-69655a17d19e" status: 200 len: 194 microversion: 2.1 time: 0.049259 Oct 17 03:18:11.236044 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 422/810] 10.222.0.27 () {58 vars in 1413 bytes} [Mon Oct 17 03:18:11 2022] GET /compute/v2.1/servers/b63b8f22-1f05-418e-b804-010e3d5cd2ae/os-volume_attachments/482be4ca-49da-42da-8a54-69655a17d19e => generated 194 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:18:11.247895 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-7fac0390-ab81-4bbb-8c97-679a2062029a tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:18:11.248647 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-7fac0390-ab81-4bbb-8c97-679a2062029a tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] [instance: b63b8f22-1f05-418e-b804-010e3d5cd2ae] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:18:11.255135 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-7fac0390-ab81-4bbb-8c97-679a2062029a tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:18:11.256478 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-7fac0390-ab81-4bbb-8c97-679a2062029a tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:18:11.256999 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-7fac0390-ab81-4bbb-8c97-679a2062029a tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:18:11.257701 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-7fac0390-ab81-4bbb-8c97-679a2062029a tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:18:11.258147 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-7fac0390-ab81-4bbb-8c97-679a2062029a tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:18:11.259116 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-7fac0390-ab81-4bbb-8c97-679a2062029a tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:18:11.351621 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.objects.instance [None req-7fac0390-ab81-4bbb-8c97-679a2062029a tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lazy-loading 'services' on Instance uuid b63b8f22-1f05-418e-b804-010e3d5cd2ae {{(pid=118887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 03:18:11.428899 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-7fac0390-ab81-4bbb-8c97-679a2062029a tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] 10.222.0.27 "DELETE /compute/v2.1/servers/b63b8f22-1f05-418e-b804-010e3d5cd2ae/os-volume_attachments/482be4ca-49da-42da-8a54-69655a17d19e" status: 202 len: 0 microversion: 2.1 time: 0.185777 Oct 17 03:18:11.429764 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 389/811] 10.222.0.27 () {58 vars in 1416 bytes} [Mon Oct 17 03:18:11 2022] DELETE /compute/v2.1/servers/b63b8f22-1f05-418e-b804-010e3d5cd2ae/os-volume_attachments/482be4ca-49da-42da-8a54-69655a17d19e => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 03:18:11.536552 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-15a6b058-5c2e-4217-9c3f-0f8c00fff438 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:18:11.539055 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-15a6b058-5c2e-4217-9c3f-0f8c00fff438 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] [instance: 87c4c474-a5ab-4532-bffa-5b3d2cb15d55] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:18:11.545719 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-15a6b058-5c2e-4217-9c3f-0f8c00fff438 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:18:11.546214 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-15a6b058-5c2e-4217-9c3f-0f8c00fff438 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:18:11.546650 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-15a6b058-5c2e-4217-9c3f-0f8c00fff438 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:18:11.547368 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-15a6b058-5c2e-4217-9c3f-0f8c00fff438 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:18:11.547986 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-15a6b058-5c2e-4217-9c3f-0f8c00fff438 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:18:11.548427 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-15a6b058-5c2e-4217-9c3f-0f8c00fff438 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:18:11.580058 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-15a6b058-5c2e-4217-9c3f-0f8c00fff438 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] 10.222.0.27 "GET /compute/v2.1/servers/87c4c474-a5ab-4532-bffa-5b3d2cb15d55/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047669 Oct 17 03:18:11.585999 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 423/812] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 17 03:18:11 2022] GET /compute/v2.1/servers/87c4c474-a5ab-4532-bffa-5b3d2cb15d55/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 03:18:11.652564 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-ac901f5b-9e36-4eaf-a4a6-8a67b778e039 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:18:11.653094 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-ac901f5b-9e36-4eaf-a4a6-8a67b778e039 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] [instance: 87c4c474-a5ab-4532-bffa-5b3d2cb15d55] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:18:11.659762 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-ac901f5b-9e36-4eaf-a4a6-8a67b778e039 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:18:11.660236 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-ac901f5b-9e36-4eaf-a4a6-8a67b778e039 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:18:11.661111 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-ac901f5b-9e36-4eaf-a4a6-8a67b778e039 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:18:11.661806 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-ac901f5b-9e36-4eaf-a4a6-8a67b778e039 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:18:11.662323 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-ac901f5b-9e36-4eaf-a4a6-8a67b778e039 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:18:11.662749 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-ac901f5b-9e36-4eaf-a4a6-8a67b778e039 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:18:11.689183 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-ac901f5b-9e36-4eaf-a4a6-8a67b778e039 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] [instance: 87c4c474-a5ab-4532-bffa-5b3d2cb15d55] Going to try to terminate instance {{(pid=118887) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 03:18:11.764411 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-ac901f5b-9e36-4eaf-a4a6-8a67b778e039 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] 10.222.0.27 "DELETE /compute/v2.1/servers/87c4c474-a5ab-4532-bffa-5b3d2cb15d55" status: 204 len: 0 microversion: 2.1 time: 0.115802 Oct 17 03:18:11.764987 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 390/813] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 03:18:11 2022] DELETE /compute/v2.1/servers/87c4c474-a5ab-4532-bffa-5b3d2cb15d55 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 03:18:11.773077 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-109bec51-9a8b-4563-8018-71f066f811aa tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:18:11.773689 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-109bec51-9a8b-4563-8018-71f066f811aa tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] [instance: 87c4c474-a5ab-4532-bffa-5b3d2cb15d55] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:18:11.780744 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-109bec51-9a8b-4563-8018-71f066f811aa tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:18:11.781231 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-109bec51-9a8b-4563-8018-71f066f811aa tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:18:11.781773 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-109bec51-9a8b-4563-8018-71f066f811aa tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:18:11.782467 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-109bec51-9a8b-4563-8018-71f066f811aa tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:18:11.782942 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-109bec51-9a8b-4563-8018-71f066f811aa tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:18:11.783364 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-109bec51-9a8b-4563-8018-71f066f811aa tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:18:11.932397 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-109bec51-9a8b-4563-8018-71f066f811aa tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c786544e8fb4e8e8c3a4990a0f36725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618cf0b3507845909bb27c13460d1d6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:18:11.940969 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-109bec51-9a8b-4563-8018-71f066f811aa tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] 10.222.0.27 "GET /compute/v2.1/servers/87c4c474-a5ab-4532-bffa-5b3d2cb15d55" status: 200 len: 1679 microversion: 2.1 time: 0.171686 Oct 17 03:18:11.941525 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 424/814] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:18:11 2022] GET /compute/v2.1/servers/87c4c474-a5ab-4532-bffa-5b3d2cb15d55 => generated 1679 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:18:12.965339 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-48890774-7eae-446f-a32b-ac9c6420d2be tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:18:12.966083 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-48890774-7eae-446f-a32b-ac9c6420d2be tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] [instance: 87c4c474-a5ab-4532-bffa-5b3d2cb15d55] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:18:12.972346 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-48890774-7eae-446f-a32b-ac9c6420d2be tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:18:12.972821 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-48890774-7eae-446f-a32b-ac9c6420d2be tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:18:12.973246 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-48890774-7eae-446f-a32b-ac9c6420d2be tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:18:12.973921 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-48890774-7eae-446f-a32b-ac9c6420d2be tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:18:12.974369 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-48890774-7eae-446f-a32b-ac9c6420d2be tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:18:12.974788 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-48890774-7eae-446f-a32b-ac9c6420d2be tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:18:13.110768 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-48890774-7eae-446f-a32b-ac9c6420d2be tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c786544e8fb4e8e8c3a4990a0f36725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618cf0b3507845909bb27c13460d1d6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:18:13.118886 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-48890774-7eae-446f-a32b-ac9c6420d2be tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] 10.222.0.27 "GET /compute/v2.1/servers/87c4c474-a5ab-4532-bffa-5b3d2cb15d55" status: 200 len: 1679 microversion: 2.1 time: 0.158089 Oct 17 03:18:13.119503 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 391/815] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:18:12 2022] GET /compute/v2.1/servers/87c4c474-a5ab-4532-bffa-5b3d2cb15d55 => generated 1679 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:18:13.693189 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-ff8b7e2f-b32f-4bcf-9779-a502737c0595 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:18:13.695491 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-ff8b7e2f-b32f-4bcf-9779-a502737c0595 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] [instance: b63b8f22-1f05-418e-b804-010e3d5cd2ae] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:18:13.702823 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-ff8b7e2f-b32f-4bcf-9779-a502737c0595 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:18:13.703339 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-ff8b7e2f-b32f-4bcf-9779-a502737c0595 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:18:13.703772 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-ff8b7e2f-b32f-4bcf-9779-a502737c0595 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:18:13.704469 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-ff8b7e2f-b32f-4bcf-9779-a502737c0595 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:18:13.704915 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-ff8b7e2f-b32f-4bcf-9779-a502737c0595 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:18:13.705508 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-ff8b7e2f-b32f-4bcf-9779-a502737c0595 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:18:13.735859 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-ff8b7e2f-b32f-4bcf-9779-a502737c0595 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] 10.222.0.27 "GET /compute/v2.1/servers/b63b8f22-1f05-418e-b804-010e3d5cd2ae/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046603 Oct 17 03:18:13.736759 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 425/816] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 17 03:18:13 2022] GET /compute/v2.1/servers/b63b8f22-1f05-418e-b804-010e3d5cd2ae/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 03:18:13.872024 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-446741f7-daad-4562-abf0-14dbec73b268 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:18:13.874304 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-446741f7-daad-4562-abf0-14dbec73b268 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] [instance: b63b8f22-1f05-418e-b804-010e3d5cd2ae] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:18:13.880253 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-446741f7-daad-4562-abf0-14dbec73b268 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:18:13.880743 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-446741f7-daad-4562-abf0-14dbec73b268 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:18:13.881186 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-446741f7-daad-4562-abf0-14dbec73b268 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:18:13.881883 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-446741f7-daad-4562-abf0-14dbec73b268 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:18:13.882347 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-446741f7-daad-4562-abf0-14dbec73b268 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:18:13.882772 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-446741f7-daad-4562-abf0-14dbec73b268 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:18:13.913475 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-446741f7-daad-4562-abf0-14dbec73b268 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] 10.222.0.27 "GET /compute/v2.1/servers/b63b8f22-1f05-418e-b804-010e3d5cd2ae/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046145 Oct 17 03:18:13.914071 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 392/817] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 17 03:18:13 2022] GET /compute/v2.1/servers/b63b8f22-1f05-418e-b804-010e3d5cd2ae/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 03:18:13.982103 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-1f91bd8a-f959-4483-99d1-f47b7ab0be2c tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:18:13.982595 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-1f91bd8a-f959-4483-99d1-f47b7ab0be2c tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] [instance: b63b8f22-1f05-418e-b804-010e3d5cd2ae] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:18:13.988683 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-1f91bd8a-f959-4483-99d1-f47b7ab0be2c tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:18:13.988990 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-1f91bd8a-f959-4483-99d1-f47b7ab0be2c tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:18:13.989418 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-1f91bd8a-f959-4483-99d1-f47b7ab0be2c tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:18:13.990157 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-1f91bd8a-f959-4483-99d1-f47b7ab0be2c tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:18:13.990830 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-1f91bd8a-f959-4483-99d1-f47b7ab0be2c tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:18:13.991280 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-1f91bd8a-f959-4483-99d1-f47b7ab0be2c tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:18:14.018259 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-1f91bd8a-f959-4483-99d1-f47b7ab0be2c tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] [instance: b63b8f22-1f05-418e-b804-010e3d5cd2ae] Going to try to terminate instance {{(pid=118886) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 03:18:14.097327 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-1f91bd8a-f959-4483-99d1-f47b7ab0be2c tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] 10.222.0.27 "DELETE /compute/v2.1/servers/b63b8f22-1f05-418e-b804-010e3d5cd2ae" status: 204 len: 0 microversion: 2.1 time: 0.118392 Oct 17 03:18:14.098338 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 426/818] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 03:18:13 2022] DELETE /compute/v2.1/servers/b63b8f22-1f05-418e-b804-010e3d5cd2ae => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 03:18:14.107138 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-7ba4cb76-35fe-4240-83a7-c57802f5fb2f tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:18:14.109265 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-7ba4cb76-35fe-4240-83a7-c57802f5fb2f tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] [instance: b63b8f22-1f05-418e-b804-010e3d5cd2ae] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:18:14.125271 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-7ba4cb76-35fe-4240-83a7-c57802f5fb2f tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:18:14.126424 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-7ba4cb76-35fe-4240-83a7-c57802f5fb2f tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:18:14.126615 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-7ba4cb76-35fe-4240-83a7-c57802f5fb2f tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:18:14.127366 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-7ba4cb76-35fe-4240-83a7-c57802f5fb2f tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:18:14.127890 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-7ba4cb76-35fe-4240-83a7-c57802f5fb2f tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:18:14.128239 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-7ba4cb76-35fe-4240-83a7-c57802f5fb2f tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:18:14.145714 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-1740dbd4-7931-4fd5-9b63-854b7dd595d1 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:18:14.146593 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-1740dbd4-7931-4fd5-9b63-854b7dd595d1 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] [instance: 87c4c474-a5ab-4532-bffa-5b3d2cb15d55] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:18:14.154101 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-1740dbd4-7931-4fd5-9b63-854b7dd595d1 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:18:14.154683 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-1740dbd4-7931-4fd5-9b63-854b7dd595d1 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:18:14.155199 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-1740dbd4-7931-4fd5-9b63-854b7dd595d1 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:18:14.156096 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-1740dbd4-7931-4fd5-9b63-854b7dd595d1 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:18:14.156543 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-1740dbd4-7931-4fd5-9b63-854b7dd595d1 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:18:14.157001 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-1740dbd4-7931-4fd5-9b63-854b7dd595d1 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:18:14.226527 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-1740dbd4-7931-4fd5-9b63-854b7dd595d1 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c786544e8fb4e8e8c3a4990a0f36725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618cf0b3507845909bb27c13460d1d6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:18:14.235426 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-1740dbd4-7931-4fd5-9b63-854b7dd595d1 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] 10.222.0.27 "GET /compute/v2.1/servers/87c4c474-a5ab-4532-bffa-5b3d2cb15d55" status: 200 len: 1613 microversion: 2.1 time: 0.094188 Oct 17 03:18:14.236003 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 427/819] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:18:14 2022] GET /compute/v2.1/servers/87c4c474-a5ab-4532-bffa-5b3d2cb15d55 => generated 1613 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:18:14.347062 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-7ba4cb76-35fe-4240-83a7-c57802f5fb2f tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce25db99a7b14d0bbaca41fff80e3da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5bad80dc0d74119b2a9cd5c1935e8d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:18:14.356755 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-7ba4cb76-35fe-4240-83a7-c57802f5fb2f tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] 10.222.0.27 "GET /compute/v2.1/servers/b63b8f22-1f05-418e-b804-010e3d5cd2ae" status: 200 len: 1674 microversion: 2.1 time: 0.253605 Oct 17 03:18:14.357356 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 393/820] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:18:14 2022] GET /compute/v2.1/servers/b63b8f22-1f05-418e-b804-010e3d5cd2ae => generated 1674 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:18:14.462519 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [req-8ba2978e-c3ce-4a67-a9af-39f58fb431eb req-72c47873-f1a1-4ae5-be5a-bd07c7455ca4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87c4c474-a5ab-4532-bffa-5b3d2cb15d55", "name": "network-vif-deleted", "tag": "5ea75a02-e55b-48e9-bc6b-8eb295df879e"}]} {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:18:14.476784 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [req-8ba2978e-c3ce-4a67-a9af-39f58fb431eb req-72c47873-f1a1-4ae5-be5a-bd07c7455ca4 service nova] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:18:14.478000 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [req-8ba2978e-c3ce-4a67-a9af-39f58fb431eb req-72c47873-f1a1-4ae5-be5a-bd07c7455ca4 service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:18:14.478684 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [req-8ba2978e-c3ce-4a67-a9af-39f58fb431eb req-72c47873-f1a1-4ae5-be5a-bd07c7455ca4 service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:18:14.483473 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG dbcounter [-] [118886] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=5,nova_cell1:INSERT=4 {{(pid=118886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:18:14.492530 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.compute.server_external_events [req-8ba2978e-c3ce-4a67-a9af-39f58fb431eb req-72c47873-f1a1-4ae5-be5a-bd07c7455ca4 service nova] Creating event network-vif-deleted:5ea75a02-e55b-48e9-bc6b-8eb295df879e for instance 87c4c474-a5ab-4532-bffa-5b3d2cb15d55 on hv-cinder-84697 Oct 17 03:18:14.498603 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [req-8ba2978e-c3ce-4a67-a9af-39f58fb431eb req-72c47873-f1a1-4ae5-be5a-bd07c7455ca4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039918 Oct 17 03:18:14.499256 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 428/821] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 03:18:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:18:15.260796 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-2b960e50-44cc-46ad-963f-6682dfc6e7d4 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:18:15.261552 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-2b960e50-44cc-46ad-963f-6682dfc6e7d4 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] [instance: 87c4c474-a5ab-4532-bffa-5b3d2cb15d55] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:18:15.268460 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-2b960e50-44cc-46ad-963f-6682dfc6e7d4 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:18:15.268946 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-2b960e50-44cc-46ad-963f-6682dfc6e7d4 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:18:15.269377 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-2b960e50-44cc-46ad-963f-6682dfc6e7d4 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:18:15.270078 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-2b960e50-44cc-46ad-963f-6682dfc6e7d4 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:18:15.270531 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-2b960e50-44cc-46ad-963f-6682dfc6e7d4 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:18:15.270974 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-2b960e50-44cc-46ad-963f-6682dfc6e7d4 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:18:15.341716 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-2b960e50-44cc-46ad-963f-6682dfc6e7d4 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c786544e8fb4e8e8c3a4990a0f36725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618cf0b3507845909bb27c13460d1d6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:18:15.349688 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-2b960e50-44cc-46ad-963f-6682dfc6e7d4 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] 10.222.0.27 "GET /compute/v2.1/servers/87c4c474-a5ab-4532-bffa-5b3d2cb15d55" status: 200 len: 1613 microversion: 2.1 time: 0.093460 Oct 17 03:18:15.350264 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 394/822] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:18:15 2022] GET /compute/v2.1/servers/87c4c474-a5ab-4532-bffa-5b3d2cb15d55 => generated 1613 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:18:15.381648 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-0f2f1eee-16c0-4ae7-8d32-d82a8e1167a5 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:18:15.382334 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-0f2f1eee-16c0-4ae7-8d32-d82a8e1167a5 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] [instance: b63b8f22-1f05-418e-b804-010e3d5cd2ae] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:18:15.391988 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-0f2f1eee-16c0-4ae7-8d32-d82a8e1167a5 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:18:15.392485 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-0f2f1eee-16c0-4ae7-8d32-d82a8e1167a5 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:18:15.392923 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-0f2f1eee-16c0-4ae7-8d32-d82a8e1167a5 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:18:15.393637 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-0f2f1eee-16c0-4ae7-8d32-d82a8e1167a5 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:18:15.394091 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-0f2f1eee-16c0-4ae7-8d32-d82a8e1167a5 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:18:15.394518 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-0f2f1eee-16c0-4ae7-8d32-d82a8e1167a5 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:18:15.531281 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-0f2f1eee-16c0-4ae7-8d32-d82a8e1167a5 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce25db99a7b14d0bbaca41fff80e3da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5bad80dc0d74119b2a9cd5c1935e8d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:18:15.539418 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-0f2f1eee-16c0-4ae7-8d32-d82a8e1167a5 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] 10.222.0.27 "GET /compute/v2.1/servers/b63b8f22-1f05-418e-b804-010e3d5cd2ae" status: 200 len: 1674 microversion: 2.1 time: 0.161930 Oct 17 03:18:15.540203 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 429/823] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:18:15 2022] GET /compute/v2.1/servers/b63b8f22-1f05-418e-b804-010e3d5cd2ae => generated 1674 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:18:16.373111 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-6dec5ebe-a0f5-43a1-97ff-1238f3074797 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:18:16.373830 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-6dec5ebe-a0f5-43a1-97ff-1238f3074797 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] [instance: 87c4c474-a5ab-4532-bffa-5b3d2cb15d55] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:18:16.380342 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-6dec5ebe-a0f5-43a1-97ff-1238f3074797 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:18:16.380948 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-6dec5ebe-a0f5-43a1-97ff-1238f3074797 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:18:16.381667 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-6dec5ebe-a0f5-43a1-97ff-1238f3074797 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:18:16.382427 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-6dec5ebe-a0f5-43a1-97ff-1238f3074797 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:18:16.383003 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-6dec5ebe-a0f5-43a1-97ff-1238f3074797 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:18:16.383429 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-6dec5ebe-a0f5-43a1-97ff-1238f3074797 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:18:16.422460 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-6dec5ebe-a0f5-43a1-97ff-1238f3074797 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:18:16.423002 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-6dec5ebe-a0f5-43a1-97ff-1238f3074797 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:18:16.423508 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-6dec5ebe-a0f5-43a1-97ff-1238f3074797 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:18:16.423971 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.objects.instance [None req-6dec5ebe-a0f5-43a1-97ff-1238f3074797 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lazy-loading 'fault' on Instance uuid 87c4c474-a5ab-4532-bffa-5b3d2cb15d55 {{(pid=118887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 03:18:16.495885 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-6dec5ebe-a0f5-43a1-97ff-1238f3074797 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c786544e8fb4e8e8c3a4990a0f36725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618cf0b3507845909bb27c13460d1d6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:18:16.503706 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-6dec5ebe-a0f5-43a1-97ff-1238f3074797 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] 10.222.0.27 "GET /compute/v2.1/servers/87c4c474-a5ab-4532-bffa-5b3d2cb15d55" status: 200 len: 1330 microversion: 2.1 time: 0.134420 Oct 17 03:18:16.504668 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 395/824] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:18:16 2022] GET /compute/v2.1/servers/87c4c474-a5ab-4532-bffa-5b3d2cb15d55 => generated 1330 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:18:16.563383 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-b35351bd-ee02-45c6-b7c2-fbf416a18872 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:18:16.564390 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-b35351bd-ee02-45c6-b7c2-fbf416a18872 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] [instance: b63b8f22-1f05-418e-b804-010e3d5cd2ae] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:18:16.572433 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-b35351bd-ee02-45c6-b7c2-fbf416a18872 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:18:16.572933 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-b35351bd-ee02-45c6-b7c2-fbf416a18872 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:18:16.573377 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-b35351bd-ee02-45c6-b7c2-fbf416a18872 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:18:16.574222 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-b35351bd-ee02-45c6-b7c2-fbf416a18872 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:18:16.574695 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-b35351bd-ee02-45c6-b7c2-fbf416a18872 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:18:16.575147 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-b35351bd-ee02-45c6-b7c2-fbf416a18872 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:18:16.650684 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-b35351bd-ee02-45c6-b7c2-fbf416a18872 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce25db99a7b14d0bbaca41fff80e3da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5bad80dc0d74119b2a9cd5c1935e8d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:18:16.658456 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-b35351bd-ee02-45c6-b7c2-fbf416a18872 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] 10.222.0.27 "GET /compute/v2.1/servers/b63b8f22-1f05-418e-b804-010e3d5cd2ae" status: 200 len: 1607 microversion: 2.1 time: 0.098891 Oct 17 03:18:16.658966 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 430/825] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:18:16 2022] GET /compute/v2.1/servers/b63b8f22-1f05-418e-b804-010e3d5cd2ae => generated 1607 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:18:16.869516 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [req-5facd6fd-7290-4678-a1bf-9a8821b05657 req-c350690e-b7e6-4f9b-9c62-85351f6a9653 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b63b8f22-1f05-418e-b804-010e3d5cd2ae", "name": "network-vif-deleted", "tag": "03d98863-7bf9-4161-be90-1840be834ea7"}]} {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:18:16.881283 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [req-5facd6fd-7290-4678-a1bf-9a8821b05657 req-c350690e-b7e6-4f9b-9c62-85351f6a9653 service nova] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:18:16.881771 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [req-5facd6fd-7290-4678-a1bf-9a8821b05657 req-c350690e-b7e6-4f9b-9c62-85351f6a9653 service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:18:16.882236 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [req-5facd6fd-7290-4678-a1bf-9a8821b05657 req-c350690e-b7e6-4f9b-9c62-85351f6a9653 service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:18:16.896300 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.compute.server_external_events [req-5facd6fd-7290-4678-a1bf-9a8821b05657 req-c350690e-b7e6-4f9b-9c62-85351f6a9653 service nova] Creating event network-vif-deleted:03d98863-7bf9-4161-be90-1840be834ea7 for instance b63b8f22-1f05-418e-b804-010e3d5cd2ae on hv-cinder-84697 Oct 17 03:18:16.901511 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [req-5facd6fd-7290-4678-a1bf-9a8821b05657 req-c350690e-b7e6-4f9b-9c62-85351f6a9653 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036532 Oct 17 03:18:16.902122 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 396/826] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 03:18:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:18:17.533415 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-a10c3ce4-f99b-418b-a332-5777a10f6665 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:18:17.534055 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-a10c3ce4-f99b-418b-a332-5777a10f6665 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] [instance: 87c4c474-a5ab-4532-bffa-5b3d2cb15d55] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:18:17.540957 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-a10c3ce4-f99b-418b-a332-5777a10f6665 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:18:17.541436 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-a10c3ce4-f99b-418b-a332-5777a10f6665 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:18:17.541863 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-a10c3ce4-f99b-418b-a332-5777a10f6665 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:18:17.542547 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-a10c3ce4-f99b-418b-a332-5777a10f6665 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:18:17.543015 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-a10c3ce4-f99b-418b-a332-5777a10f6665 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:18:17.543432 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-a10c3ce4-f99b-418b-a332-5777a10f6665 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:18:17.557807 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.wsgi [None req-a10c3ce4-f99b-418b-a332-5777a10f6665 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] HTTP exception thrown: Instance 87c4c474-a5ab-4532-bffa-5b3d2cb15d55 could not be found. Oct 17 03:18:17.559483 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-a10c3ce4-f99b-418b-a332-5777a10f6665 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Request method failure captured: Oct 17 03:18:17.559483 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: request: GET /compute/v2.1/servers/87c4c474-a5ab-4532-bffa-5b3d2cb15d55 HTTP/1.1 Oct 17 03:18:17.559483 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Accept: application/json Oct 17 03:18:17.559483 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Accept-Encoding: identity Oct 17 03:18:17.559483 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Connection: close Oct 17 03:18:17.559483 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Content-Length: 0 Oct 17 03:18:17.559483 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Content-Type: application/json Oct 17 03:18:17.559483 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Host: 10.222.0.27 Oct 17 03:18:17.559483 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Openstack-System-Scope: None Oct 17 03:18:17.559483 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: User-Agent: python-urllib3/1.26.12 Oct 17 03:18:17.559483 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Auth-Token: gAAAAABjTMf-SpDw6REUqxlSOIvhtlgFxCyi7gugHXw9249WtXgpgYG8a0yyM9JbvLErgztKU1aaT378mlFtg9Uhrjdru2uD9-W4FJ-CkFLSVPWuyDvIf6q3m3rDvz5qZHkGg2K6V9p96rkOt2BGqAhrNrGmStKoZpndwIVbln6Rg2eRSFSEBDA Oct 17 03:18:17.559483 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Domain-Id: None Oct 17 03:18:17.559483 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Domain-Name: None Oct 17 03:18:17.559483 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Identity-Status: Confirmed Oct 17 03:18:17.559483 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Is-Admin-Project: True Oct 17 03:18:17.559483 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Project-Domain-Id: default Oct 17 03:18:17.559483 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Project-Domain-Name: Default Oct 17 03:18:17.559483 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Project-Id: 618cf0b3507845909bb27c13460d1d6c Oct 17 03:18:17.559483 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Project-Name: tempest-AttachVolumeNegativeTest-816799241 Oct 17 03:18:17.559483 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Role: member,reader Oct 17 03:18:17.559483 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Roles: member,reader Oct 17 03:18:17.560996 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/618cf0b3507845909bb27c13460d1d6c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/618cf0b3507845909bb27c13460d1d6c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/618cf0b3507845909bb27c13460d1d6c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_618cf0b3507845909bb27c13460d1d6c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 17 03:18:17.560996 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Tenant: tempest-AttachVolumeNegativeTest-816799241 Oct 17 03:18:17.560996 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Tenant-Id: 618cf0b3507845909bb27c13460d1d6c Oct 17 03:18:17.560996 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-816799241 Oct 17 03:18:17.560996 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-User: tempest-AttachVolumeNegativeTest-816799241-project Oct 17 03:18:17.560996 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-User-Domain-Id: default Oct 17 03:18:17.560996 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-User-Domain-Name: Default Oct 17 03:18:17.560996 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-User-Id: 1c786544e8fb4e8e8c3a4990a0f36725 Oct 17 03:18:17.560996 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-User-Name: tempest-AttachVolumeNegativeTest-816799241-project Oct 17 03:18:17.560996 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: method: > Oct 17 03:18:17.560996 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: exception: Instance 87c4c474-a5ab-4532-bffa-5b3d2cb15d55 could not be found. Oct 17 03:18:17.560996 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: action_args: {'id': '87c4c474-a5ab-4532-bffa-5b3d2cb15d55'} Oct 17 03:18:17.561985 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 03:18:17.561985 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:18:17.561985 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 03:18:17.561985 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 03:18:17.561985 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 03:18:17.561985 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 03:18:17.561985 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 03:18:17.561985 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 03:18:17.561985 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 03:18:17.561985 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 03:18:17.561985 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87c4c474-a5ab-4532-bffa-5b3d2cb15d55 could not be found. Oct 17 03:18:17.561985 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Oct 17 03:18:17.561985 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:18:17.561985 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Oct 17 03:18:17.561985 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:18:17.561985 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:18:17.561985 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:18:17.561985 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 03:18:17.561985 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 03:18:17.561985 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 03:18:17.564004 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 03:18:17.564004 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 03:18:17.564004 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 03:18:17.564004 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 03:18:17.564004 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 03:18:17.564004 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 03:18:17.564004 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 03:18:17.564004 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87c4c474-a5ab-4532-bffa-5b3d2cb15d55 could not be found. Oct 17 03:18:17.564004 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Oct 17 03:18:17.564004 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:18:17.564004 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Oct 17 03:18:17.564004 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:18:17.564004 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:18:17.564004 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:18:17.564004 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 03:18:17.564004 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 03:18:17.564004 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87c4c474-a5ab-4532-bffa-5b3d2cb15d55 could not be found. Oct 17 03:18:17.564004 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Oct 17 03:18:17.565415 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-a10c3ce4-f99b-418b-a332-5777a10f6665 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Returning 404 to user: Instance 87c4c474-a5ab-4532-bffa-5b3d2cb15d55 could not be found. {{(pid=118886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 03:18:17.565415 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-a10c3ce4-f99b-418b-a332-5777a10f6665 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] 10.222.0.27 "GET /compute/v2.1/servers/87c4c474-a5ab-4532-bffa-5b3d2cb15d55" status: 404 len: 111 microversion: 2.1 time: 0.031348 Oct 17 03:18:17.565415 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 431/827] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:18:17 2022] GET /compute/v2.1/servers/87c4c474-a5ab-4532-bffa-5b3d2cb15d55 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 03:18:17.570314 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-ceb1526b-b199-45c6-8a02-87085ac57b27 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Calling method '.version_select at 0x7fc7016f1c10>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:18:17.591179 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-ceb1526b-b199-45c6-8a02-87085ac57b27 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-208486779" status: 202 len: 0 microversion: 2.1 time: 0.024969 Oct 17 03:18:17.592213 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 397/828] 10.222.0.27 () {58 vars in 1218 bytes} [Mon Oct 17 03:18:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-208486779 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 03:18:17.683537 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-ef526cda-9e60-4b71-8d4b-5ad2efd14e49 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:18:17.684148 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-ef526cda-9e60-4b71-8d4b-5ad2efd14e49 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] [instance: b63b8f22-1f05-418e-b804-010e3d5cd2ae] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:18:17.690268 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-ef526cda-9e60-4b71-8d4b-5ad2efd14e49 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:18:17.690736 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-ef526cda-9e60-4b71-8d4b-5ad2efd14e49 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:18:17.691210 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-ef526cda-9e60-4b71-8d4b-5ad2efd14e49 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:18:17.692065 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-ef526cda-9e60-4b71-8d4b-5ad2efd14e49 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:18:17.692673 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-ef526cda-9e60-4b71-8d4b-5ad2efd14e49 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:18:17.693383 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-ef526cda-9e60-4b71-8d4b-5ad2efd14e49 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:18:17.707815 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.wsgi [None req-ef526cda-9e60-4b71-8d4b-5ad2efd14e49 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] HTTP exception thrown: Instance b63b8f22-1f05-418e-b804-010e3d5cd2ae could not be found. Oct 17 03:18:17.709548 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-ef526cda-9e60-4b71-8d4b-5ad2efd14e49 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Request method failure captured: Oct 17 03:18:17.709548 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: request: GET /compute/v2.1/servers/b63b8f22-1f05-418e-b804-010e3d5cd2ae HTTP/1.1 Oct 17 03:18:17.709548 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Accept: application/json Oct 17 03:18:17.709548 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Accept-Encoding: identity Oct 17 03:18:17.709548 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Connection: close Oct 17 03:18:17.709548 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Content-Length: 0 Oct 17 03:18:17.709548 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Content-Type: application/json Oct 17 03:18:17.709548 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Host: 10.222.0.27 Oct 17 03:18:17.709548 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Openstack-System-Scope: None Oct 17 03:18:17.709548 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: User-Agent: python-urllib3/1.26.12 Oct 17 03:18:17.709548 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Auth-Token: gAAAAABjTMf8JV6UANmoo3RCAe3xHSgPfZQVEBdFiPOEb_yO9Ct8ESAfEcnl03KATLNHNncGiIS4w8OY6GoKRN1y8W0XRxZTqKeCFzVtwZG7Bj3lhhKwcXkyi4Qg3fTqOg5f9fTHbmt5uLBux2T8UAxLVbxjUk77x2aNLLIBADgWKyi7sbgIkng Oct 17 03:18:17.709548 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Domain-Id: None Oct 17 03:18:17.709548 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Domain-Name: None Oct 17 03:18:17.709548 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Identity-Status: Confirmed Oct 17 03:18:17.709548 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Is-Admin-Project: True Oct 17 03:18:17.709548 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Project-Domain-Id: default Oct 17 03:18:17.709548 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Project-Domain-Name: Default Oct 17 03:18:17.709548 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Project-Id: e5bad80dc0d74119b2a9cd5c1935e8d5 Oct 17 03:18:17.709548 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Project-Name: tempest-AttachVolumeTestJSON-1921657918 Oct 17 03:18:17.709548 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Role: member,reader Oct 17 03:18:17.709548 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Roles: member,reader Oct 17 03:18:17.711148 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e5bad80dc0d74119b2a9cd5c1935e8d5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e5bad80dc0d74119b2a9cd5c1935e8d5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e5bad80dc0d74119b2a9cd5c1935e8d5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e5bad80dc0d74119b2a9cd5c1935e8d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 17 03:18:17.711148 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Tenant: tempest-AttachVolumeTestJSON-1921657918 Oct 17 03:18:17.711148 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Tenant-Id: e5bad80dc0d74119b2a9cd5c1935e8d5 Oct 17 03:18:17.711148 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1921657918 Oct 17 03:18:17.711148 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-User: tempest-AttachVolumeTestJSON-1921657918-project Oct 17 03:18:17.711148 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-User-Domain-Id: default Oct 17 03:18:17.711148 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-User-Domain-Name: Default Oct 17 03:18:17.711148 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-User-Id: ce25db99a7b14d0bbaca41fff80e3da9 Oct 17 03:18:17.711148 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-User-Name: tempest-AttachVolumeTestJSON-1921657918-project Oct 17 03:18:17.711148 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: method: > Oct 17 03:18:17.711148 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: exception: Instance b63b8f22-1f05-418e-b804-010e3d5cd2ae could not be found. Oct 17 03:18:17.711148 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: action_args: {'id': 'b63b8f22-1f05-418e-b804-010e3d5cd2ae'} Oct 17 03:18:17.712769 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 03:18:17.712769 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:18:17.712769 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 03:18:17.712769 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 03:18:17.712769 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 03:18:17.712769 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 03:18:17.712769 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 03:18:17.712769 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 03:18:17.712769 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 03:18:17.712769 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 03:18:17.712769 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b63b8f22-1f05-418e-b804-010e3d5cd2ae could not be found. Oct 17 03:18:17.712769 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Oct 17 03:18:17.712769 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:18:17.712769 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Oct 17 03:18:17.712769 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:18:17.712769 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:18:17.712769 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:18:17.712769 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 03:18:17.712769 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 03:18:17.712769 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 03:18:17.714103 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 03:18:17.714103 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 03:18:17.714103 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 03:18:17.714103 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 03:18:17.714103 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 03:18:17.714103 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 03:18:17.714103 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 03:18:17.714103 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b63b8f22-1f05-418e-b804-010e3d5cd2ae could not be found. Oct 17 03:18:17.714103 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Oct 17 03:18:17.714103 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:18:17.714103 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Oct 17 03:18:17.714103 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:18:17.714103 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:18:17.714103 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:18:17.714103 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 03:18:17.714103 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 03:18:17.714103 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b63b8f22-1f05-418e-b804-010e3d5cd2ae could not be found. Oct 17 03:18:17.714103 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Oct 17 03:18:17.715268 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-ef526cda-9e60-4b71-8d4b-5ad2efd14e49 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Returning 404 to user: Instance b63b8f22-1f05-418e-b804-010e3d5cd2ae could not be found. {{(pid=118886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 03:18:17.715268 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-ef526cda-9e60-4b71-8d4b-5ad2efd14e49 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] 10.222.0.27 "GET /compute/v2.1/servers/b63b8f22-1f05-418e-b804-010e3d5cd2ae" status: 404 len: 111 microversion: 2.1 time: 0.033174 Oct 17 03:18:17.715268 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 432/829] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:18:17 2022] GET /compute/v2.1/servers/b63b8f22-1f05-418e-b804-010e3d5cd2ae => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 03:18:17.721606 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-d18ddafd-a2ea-48db-a219-b9df8dcf24d1 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Calling method '.version_select at 0x7fc7016bcb80>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:18:17.751399 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-d18ddafd-a2ea-48db-a219-b9df8dcf24d1 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1036338029" status: 202 len: 0 microversion: 2.1 time: 0.032867 Oct 17 03:18:17.752386 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 398/830] 10.222.0.27 () {58 vars in 1221 bytes} [Mon Oct 17 03:18:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1036338029 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 03:18:19.462754 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-fc013866-b809-4f19-bf35-75b297e34cd9 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:18:19.463256 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-fc013866-b809-4f19-bf35-75b297e34cd9 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] [instance: 87c4c474-a5ab-4532-bffa-5b3d2cb15d55] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:18:19.469511 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-fc013866-b809-4f19-bf35-75b297e34cd9 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:18:19.469984 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-fc013866-b809-4f19-bf35-75b297e34cd9 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:18:19.470414 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-fc013866-b809-4f19-bf35-75b297e34cd9 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:18:19.471178 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-fc013866-b809-4f19-bf35-75b297e34cd9 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:18:19.471772 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-fc013866-b809-4f19-bf35-75b297e34cd9 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:18:19.472225 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-fc013866-b809-4f19-bf35-75b297e34cd9 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:18:19.486586 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.wsgi [None req-fc013866-b809-4f19-bf35-75b297e34cd9 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] HTTP exception thrown: Instance 87c4c474-a5ab-4532-bffa-5b3d2cb15d55 could not be found. Oct 17 03:18:19.488174 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-fc013866-b809-4f19-bf35-75b297e34cd9 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Request method failure captured: Oct 17 03:18:19.488174 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: request: DELETE /compute/v2.1/servers/87c4c474-a5ab-4532-bffa-5b3d2cb15d55 HTTP/1.1 Oct 17 03:18:19.488174 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Accept: application/json Oct 17 03:18:19.488174 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Accept-Encoding: identity Oct 17 03:18:19.488174 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Connection: close Oct 17 03:18:19.488174 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Content-Length: 0 Oct 17 03:18:19.488174 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Content-Type: application/json Oct 17 03:18:19.488174 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Host: 10.222.0.27 Oct 17 03:18:19.488174 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Openstack-System-Scope: None Oct 17 03:18:19.488174 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: User-Agent: python-urllib3/1.26.12 Oct 17 03:18:19.488174 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Auth-Token: gAAAAABjTMf-SpDw6REUqxlSOIvhtlgFxCyi7gugHXw9249WtXgpgYG8a0yyM9JbvLErgztKU1aaT378mlFtg9Uhrjdru2uD9-W4FJ-CkFLSVPWuyDvIf6q3m3rDvz5qZHkGg2K6V9p96rkOt2BGqAhrNrGmStKoZpndwIVbln6Rg2eRSFSEBDA Oct 17 03:18:19.488174 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Domain-Id: None Oct 17 03:18:19.488174 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Domain-Name: None Oct 17 03:18:19.488174 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Identity-Status: Confirmed Oct 17 03:18:19.488174 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Is-Admin-Project: True Oct 17 03:18:19.488174 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Project-Domain-Id: default Oct 17 03:18:19.488174 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Project-Domain-Name: Default Oct 17 03:18:19.488174 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Project-Id: 618cf0b3507845909bb27c13460d1d6c Oct 17 03:18:19.488174 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Project-Name: tempest-AttachVolumeNegativeTest-816799241 Oct 17 03:18:19.488174 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Role: member,reader Oct 17 03:18:19.488174 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Roles: member,reader Oct 17 03:18:19.489738 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/618cf0b3507845909bb27c13460d1d6c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/618cf0b3507845909bb27c13460d1d6c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/618cf0b3507845909bb27c13460d1d6c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_618cf0b3507845909bb27c13460d1d6c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 17 03:18:19.489738 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Tenant: tempest-AttachVolumeNegativeTest-816799241 Oct 17 03:18:19.489738 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Tenant-Id: 618cf0b3507845909bb27c13460d1d6c Oct 17 03:18:19.489738 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-816799241 Oct 17 03:18:19.489738 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-User: tempest-AttachVolumeNegativeTest-816799241-project Oct 17 03:18:19.489738 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-User-Domain-Id: default Oct 17 03:18:19.489738 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-User-Domain-Name: Default Oct 17 03:18:19.489738 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-User-Id: 1c786544e8fb4e8e8c3a4990a0f36725 Oct 17 03:18:19.489738 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-User-Name: tempest-AttachVolumeNegativeTest-816799241-project Oct 17 03:18:19.489738 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: method: > Oct 17 03:18:19.489738 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: exception: Instance 87c4c474-a5ab-4532-bffa-5b3d2cb15d55 could not be found. Oct 17 03:18:19.489738 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: action_args: {'id': '87c4c474-a5ab-4532-bffa-5b3d2cb15d55'} Oct 17 03:18:19.490539 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 03:18:19.490539 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:18:19.490539 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 03:18:19.490539 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 03:18:19.490539 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 03:18:19.490539 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 03:18:19.490539 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 03:18:19.490539 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 03:18:19.490539 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 03:18:19.490539 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 03:18:19.490539 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87c4c474-a5ab-4532-bffa-5b3d2cb15d55 could not be found. Oct 17 03:18:19.490539 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Oct 17 03:18:19.490539 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:18:19.490539 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Oct 17 03:18:19.490539 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:18:19.490539 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:18:19.490539 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:18:19.490539 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 03:18:19.490539 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 03:18:19.490539 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 03:18:19.491995 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 03:18:19.491995 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 03:18:19.491995 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 03:18:19.491995 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 03:18:19.491995 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 03:18:19.491995 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 03:18:19.491995 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 03:18:19.491995 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 03:18:19.491995 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 03:18:19.491995 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87c4c474-a5ab-4532-bffa-5b3d2cb15d55 could not be found. Oct 17 03:18:19.491995 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Oct 17 03:18:19.491995 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:18:19.491995 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Oct 17 03:18:19.491995 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:18:19.491995 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:18:19.491995 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:18:19.491995 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 03:18:19.491995 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 03:18:19.491995 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87c4c474-a5ab-4532-bffa-5b3d2cb15d55 could not be found. Oct 17 03:18:19.491995 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Oct 17 03:18:19.493396 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-fc013866-b809-4f19-bf35-75b297e34cd9 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Returning 404 to user: Instance 87c4c474-a5ab-4532-bffa-5b3d2cb15d55 could not be found. {{(pid=118886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 03:18:19.493396 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-fc013866-b809-4f19-bf35-75b297e34cd9 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] 10.222.0.27 "DELETE /compute/v2.1/servers/87c4c474-a5ab-4532-bffa-5b3d2cb15d55" status: 404 len: 111 microversion: 2.1 time: 0.031104 Oct 17 03:18:19.493396 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 433/831] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 03:18:19 2022] DELETE /compute/v2.1/servers/87c4c474-a5ab-4532-bffa-5b3d2cb15d55 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 03:18:19.498563 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-d08b4e3c-aa7c-4009-9cd7-a62879cd92dc tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:18:19.499318 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-d08b4e3c-aa7c-4009-9cd7-a62879cd92dc tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] [instance: 87c4c474-a5ab-4532-bffa-5b3d2cb15d55] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:18:19.505310 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-d08b4e3c-aa7c-4009-9cd7-a62879cd92dc tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:18:19.505780 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-d08b4e3c-aa7c-4009-9cd7-a62879cd92dc tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:18:19.506206 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-d08b4e3c-aa7c-4009-9cd7-a62879cd92dc tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:18:19.506892 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-d08b4e3c-aa7c-4009-9cd7-a62879cd92dc tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:18:19.507367 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-d08b4e3c-aa7c-4009-9cd7-a62879cd92dc tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:18:19.507781 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-d08b4e3c-aa7c-4009-9cd7-a62879cd92dc tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:18:19.521403 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.wsgi [None req-d08b4e3c-aa7c-4009-9cd7-a62879cd92dc tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] HTTP exception thrown: Instance 87c4c474-a5ab-4532-bffa-5b3d2cb15d55 could not be found. Oct 17 03:18:19.523082 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-d08b4e3c-aa7c-4009-9cd7-a62879cd92dc tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Request method failure captured: Oct 17 03:18:19.523082 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: request: GET /compute/v2.1/servers/87c4c474-a5ab-4532-bffa-5b3d2cb15d55 HTTP/1.1 Oct 17 03:18:19.523082 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Accept: application/json Oct 17 03:18:19.523082 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Accept-Encoding: identity Oct 17 03:18:19.523082 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Connection: close Oct 17 03:18:19.523082 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Content-Length: 0 Oct 17 03:18:19.523082 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Content-Type: application/json Oct 17 03:18:19.523082 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Host: 10.222.0.27 Oct 17 03:18:19.523082 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Openstack-System-Scope: None Oct 17 03:18:19.523082 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: User-Agent: python-urllib3/1.26.12 Oct 17 03:18:19.523082 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Auth-Token: gAAAAABjTMf-SpDw6REUqxlSOIvhtlgFxCyi7gugHXw9249WtXgpgYG8a0yyM9JbvLErgztKU1aaT378mlFtg9Uhrjdru2uD9-W4FJ-CkFLSVPWuyDvIf6q3m3rDvz5qZHkGg2K6V9p96rkOt2BGqAhrNrGmStKoZpndwIVbln6Rg2eRSFSEBDA Oct 17 03:18:19.523082 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Domain-Id: None Oct 17 03:18:19.523082 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Domain-Name: None Oct 17 03:18:19.523082 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Identity-Status: Confirmed Oct 17 03:18:19.523082 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Is-Admin-Project: True Oct 17 03:18:19.523082 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Project-Domain-Id: default Oct 17 03:18:19.523082 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Project-Domain-Name: Default Oct 17 03:18:19.523082 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Project-Id: 618cf0b3507845909bb27c13460d1d6c Oct 17 03:18:19.523082 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Project-Name: tempest-AttachVolumeNegativeTest-816799241 Oct 17 03:18:19.523082 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Role: member,reader Oct 17 03:18:19.523082 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Roles: member,reader Oct 17 03:18:19.527658 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/618cf0b3507845909bb27c13460d1d6c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/618cf0b3507845909bb27c13460d1d6c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/618cf0b3507845909bb27c13460d1d6c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_618cf0b3507845909bb27c13460d1d6c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 17 03:18:19.527658 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Tenant: tempest-AttachVolumeNegativeTest-816799241 Oct 17 03:18:19.527658 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Tenant-Id: 618cf0b3507845909bb27c13460d1d6c Oct 17 03:18:19.527658 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-816799241 Oct 17 03:18:19.527658 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-User: tempest-AttachVolumeNegativeTest-816799241-project Oct 17 03:18:19.527658 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-User-Domain-Id: default Oct 17 03:18:19.527658 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-User-Domain-Name: Default Oct 17 03:18:19.527658 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-User-Id: 1c786544e8fb4e8e8c3a4990a0f36725 Oct 17 03:18:19.527658 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-User-Name: tempest-AttachVolumeNegativeTest-816799241-project Oct 17 03:18:19.527658 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: method: > Oct 17 03:18:19.527658 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: exception: Instance 87c4c474-a5ab-4532-bffa-5b3d2cb15d55 could not be found. Oct 17 03:18:19.527658 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: action_args: {'id': '87c4c474-a5ab-4532-bffa-5b3d2cb15d55'} Oct 17 03:18:19.528844 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 03:18:19.528844 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:18:19.528844 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 03:18:19.528844 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 03:18:19.528844 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 03:18:19.528844 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 03:18:19.528844 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 03:18:19.528844 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 03:18:19.528844 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 03:18:19.528844 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 03:18:19.528844 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87c4c474-a5ab-4532-bffa-5b3d2cb15d55 could not be found. Oct 17 03:18:19.528844 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Oct 17 03:18:19.528844 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:18:19.528844 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Oct 17 03:18:19.528844 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:18:19.528844 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:18:19.528844 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:18:19.528844 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 03:18:19.528844 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 03:18:19.528844 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 03:18:19.530707 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 03:18:19.530707 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 03:18:19.530707 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 03:18:19.530707 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 03:18:19.530707 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 03:18:19.530707 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 03:18:19.530707 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 03:18:19.530707 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87c4c474-a5ab-4532-bffa-5b3d2cb15d55 could not be found. Oct 17 03:18:19.530707 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Oct 17 03:18:19.530707 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:18:19.530707 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Oct 17 03:18:19.530707 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:18:19.530707 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:18:19.530707 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:18:19.530707 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 03:18:19.530707 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 03:18:19.530707 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87c4c474-a5ab-4532-bffa-5b3d2cb15d55 could not be found. Oct 17 03:18:19.530707 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Oct 17 03:18:19.532151 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-d08b4e3c-aa7c-4009-9cd7-a62879cd92dc tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Returning 404 to user: Instance 87c4c474-a5ab-4532-bffa-5b3d2cb15d55 could not be found. {{(pid=118887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 03:18:19.532151 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-d08b4e3c-aa7c-4009-9cd7-a62879cd92dc tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] 10.222.0.27 "GET /compute/v2.1/servers/87c4c474-a5ab-4532-bffa-5b3d2cb15d55" status: 404 len: 111 microversion: 2.1 time: 0.030817 Oct 17 03:18:19.532151 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 399/832] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:18:19 2022] GET /compute/v2.1/servers/87c4c474-a5ab-4532-bffa-5b3d2cb15d55 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 03:18:20.674997 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-6d1d73e8-d3c2-419e-8fb4-25b66ee715c3 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:18:20.675553 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-6d1d73e8-d3c2-419e-8fb4-25b66ee715c3 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] [instance: d521fa69-4f04-4d79-8a81-22b2e4bafbae] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:18:20.682386 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-6d1d73e8-d3c2-419e-8fb4-25b66ee715c3 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:18:20.682893 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-6d1d73e8-d3c2-419e-8fb4-25b66ee715c3 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:18:20.683335 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-6d1d73e8-d3c2-419e-8fb4-25b66ee715c3 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:18:20.684278 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-6d1d73e8-d3c2-419e-8fb4-25b66ee715c3 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:18:20.684876 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-6d1d73e8-d3c2-419e-8fb4-25b66ee715c3 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:18:20.685307 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-6d1d73e8-d3c2-419e-8fb4-25b66ee715c3 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:18:20.696012 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-57af0ef6-eea9-4020-9ba3-18fcfc21882a tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:18:20.696509 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-57af0ef6-eea9-4020-9ba3-18fcfc21882a tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] [instance: b63b8f22-1f05-418e-b804-010e3d5cd2ae] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:18:20.700356 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.wsgi [None req-6d1d73e8-d3c2-419e-8fb4-25b66ee715c3 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] HTTP exception thrown: Instance d521fa69-4f04-4d79-8a81-22b2e4bafbae could not be found. Oct 17 03:18:20.702071 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-6d1d73e8-d3c2-419e-8fb4-25b66ee715c3 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Request method failure captured: Oct 17 03:18:20.702071 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: request: DELETE /compute/v2.1/servers/d521fa69-4f04-4d79-8a81-22b2e4bafbae HTTP/1.1 Oct 17 03:18:20.702071 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Accept: application/json Oct 17 03:18:20.702071 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Accept-Encoding: identity Oct 17 03:18:20.702071 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Connection: close Oct 17 03:18:20.702071 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Content-Length: 0 Oct 17 03:18:20.702071 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Content-Type: application/json Oct 17 03:18:20.702071 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Host: 10.222.0.27 Oct 17 03:18:20.702071 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Openstack-System-Scope: None Oct 17 03:18:20.702071 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: User-Agent: python-urllib3/1.26.12 Oct 17 03:18:20.702071 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Auth-Token: gAAAAABjTMf-SpDw6REUqxlSOIvhtlgFxCyi7gugHXw9249WtXgpgYG8a0yyM9JbvLErgztKU1aaT378mlFtg9Uhrjdru2uD9-W4FJ-CkFLSVPWuyDvIf6q3m3rDvz5qZHkGg2K6V9p96rkOt2BGqAhrNrGmStKoZpndwIVbln6Rg2eRSFSEBDA Oct 17 03:18:20.702071 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Domain-Id: None Oct 17 03:18:20.702071 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Domain-Name: None Oct 17 03:18:20.702071 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Identity-Status: Confirmed Oct 17 03:18:20.702071 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Is-Admin-Project: True Oct 17 03:18:20.702071 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Project-Domain-Id: default Oct 17 03:18:20.702071 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Project-Domain-Name: Default Oct 17 03:18:20.702071 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Project-Id: 618cf0b3507845909bb27c13460d1d6c Oct 17 03:18:20.702071 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Project-Name: tempest-AttachVolumeNegativeTest-816799241 Oct 17 03:18:20.702071 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Role: member,reader Oct 17 03:18:20.702071 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Roles: member,reader Oct 17 03:18:20.703658 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/618cf0b3507845909bb27c13460d1d6c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/618cf0b3507845909bb27c13460d1d6c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/618cf0b3507845909bb27c13460d1d6c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_618cf0b3507845909bb27c13460d1d6c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 17 03:18:20.703658 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Tenant: tempest-AttachVolumeNegativeTest-816799241 Oct 17 03:18:20.703658 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Tenant-Id: 618cf0b3507845909bb27c13460d1d6c Oct 17 03:18:20.703658 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-816799241 Oct 17 03:18:20.703658 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-User: tempest-AttachVolumeNegativeTest-816799241-project Oct 17 03:18:20.703658 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-User-Domain-Id: default Oct 17 03:18:20.703658 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-User-Domain-Name: Default Oct 17 03:18:20.703658 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-User-Id: 1c786544e8fb4e8e8c3a4990a0f36725 Oct 17 03:18:20.703658 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-User-Name: tempest-AttachVolumeNegativeTest-816799241-project Oct 17 03:18:20.703658 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: method: > Oct 17 03:18:20.703658 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: exception: Instance d521fa69-4f04-4d79-8a81-22b2e4bafbae could not be found. Oct 17 03:18:20.703658 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: action_args: {'id': 'd521fa69-4f04-4d79-8a81-22b2e4bafbae'} Oct 17 03:18:20.704577 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 03:18:20.704577 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:18:20.704577 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 03:18:20.704577 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 03:18:20.704577 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 03:18:20.704577 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 03:18:20.704577 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 03:18:20.704577 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 03:18:20.704577 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 03:18:20.704577 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 03:18:20.704577 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d521fa69-4f04-4d79-8a81-22b2e4bafbae could not be found. Oct 17 03:18:20.704577 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Oct 17 03:18:20.704577 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:18:20.704577 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Oct 17 03:18:20.704577 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:18:20.704577 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:18:20.704577 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:18:20.704577 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 03:18:20.704577 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 03:18:20.704577 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 03:18:20.705818 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 03:18:20.705818 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 03:18:20.705818 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 03:18:20.705818 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 03:18:20.705818 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 03:18:20.705818 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 03:18:20.705818 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 03:18:20.705818 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 03:18:20.705818 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 03:18:20.705818 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d521fa69-4f04-4d79-8a81-22b2e4bafbae could not be found. Oct 17 03:18:20.705818 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Oct 17 03:18:20.705818 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:18:20.705818 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Oct 17 03:18:20.705818 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:18:20.705818 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:18:20.705818 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:18:20.705818 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 03:18:20.705818 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 03:18:20.705818 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d521fa69-4f04-4d79-8a81-22b2e4bafbae could not be found. Oct 17 03:18:20.705818 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Oct 17 03:18:20.707109 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-6d1d73e8-d3c2-419e-8fb4-25b66ee715c3 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Returning 404 to user: Instance d521fa69-4f04-4d79-8a81-22b2e4bafbae could not be found. {{(pid=118886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 03:18:20.707109 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-6d1d73e8-d3c2-419e-8fb4-25b66ee715c3 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] 10.222.0.27 "DELETE /compute/v2.1/servers/d521fa69-4f04-4d79-8a81-22b2e4bafbae" status: 404 len: 111 microversion: 2.1 time: 0.032590 Oct 17 03:18:20.707275 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-57af0ef6-eea9-4020-9ba3-18fcfc21882a tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:18:20.707275 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-57af0ef6-eea9-4020-9ba3-18fcfc21882a tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:18:20.707432 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 434/833] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 03:18:20 2022] DELETE /compute/v2.1/servers/d521fa69-4f04-4d79-8a81-22b2e4bafbae => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 03:18:20.707508 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-57af0ef6-eea9-4020-9ba3-18fcfc21882a tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:18:20.707508 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-57af0ef6-eea9-4020-9ba3-18fcfc21882a tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:18:20.707508 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-57af0ef6-eea9-4020-9ba3-18fcfc21882a tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:18:20.707508 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-57af0ef6-eea9-4020-9ba3-18fcfc21882a tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:18:20.712545 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-af5ed120-ced7-42b8-8571-67dc66eb8d63 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:18:20.713262 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-af5ed120-ced7-42b8-8571-67dc66eb8d63 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] [instance: d521fa69-4f04-4d79-8a81-22b2e4bafbae] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:18:20.719345 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-af5ed120-ced7-42b8-8571-67dc66eb8d63 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:18:20.720058 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-af5ed120-ced7-42b8-8571-67dc66eb8d63 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:18:20.720485 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-af5ed120-ced7-42b8-8571-67dc66eb8d63 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:18:20.720837 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.wsgi [None req-57af0ef6-eea9-4020-9ba3-18fcfc21882a tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] HTTP exception thrown: Instance b63b8f22-1f05-418e-b804-010e3d5cd2ae could not be found. Oct 17 03:18:20.721171 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-af5ed120-ced7-42b8-8571-67dc66eb8d63 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:18:20.721616 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-af5ed120-ced7-42b8-8571-67dc66eb8d63 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:18:20.722031 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-af5ed120-ced7-42b8-8571-67dc66eb8d63 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:18:20.722381 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-57af0ef6-eea9-4020-9ba3-18fcfc21882a tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Request method failure captured: Oct 17 03:18:20.722381 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: request: DELETE /compute/v2.1/servers/b63b8f22-1f05-418e-b804-010e3d5cd2ae HTTP/1.1 Oct 17 03:18:20.722381 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Accept: application/json Oct 17 03:18:20.722381 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Accept-Encoding: identity Oct 17 03:18:20.722381 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Connection: close Oct 17 03:18:20.722381 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Content-Length: 0 Oct 17 03:18:20.722381 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Content-Type: application/json Oct 17 03:18:20.722381 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Host: 10.222.0.27 Oct 17 03:18:20.722381 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Openstack-System-Scope: None Oct 17 03:18:20.722381 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: User-Agent: python-urllib3/1.26.12 Oct 17 03:18:20.722381 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Auth-Token: gAAAAABjTMf8JV6UANmoo3RCAe3xHSgPfZQVEBdFiPOEb_yO9Ct8ESAfEcnl03KATLNHNncGiIS4w8OY6GoKRN1y8W0XRxZTqKeCFzVtwZG7Bj3lhhKwcXkyi4Qg3fTqOg5f9fTHbmt5uLBux2T8UAxLVbxjUk77x2aNLLIBADgWKyi7sbgIkng Oct 17 03:18:20.722381 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Domain-Id: None Oct 17 03:18:20.722381 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Domain-Name: None Oct 17 03:18:20.722381 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Identity-Status: Confirmed Oct 17 03:18:20.722381 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Is-Admin-Project: True Oct 17 03:18:20.722381 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Project-Domain-Id: default Oct 17 03:18:20.722381 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Project-Domain-Name: Default Oct 17 03:18:20.722381 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Project-Id: e5bad80dc0d74119b2a9cd5c1935e8d5 Oct 17 03:18:20.722381 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Project-Name: tempest-AttachVolumeTestJSON-1921657918 Oct 17 03:18:20.722381 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Role: member,reader Oct 17 03:18:20.722381 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Roles: member,reader Oct 17 03:18:20.724095 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e5bad80dc0d74119b2a9cd5c1935e8d5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e5bad80dc0d74119b2a9cd5c1935e8d5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e5bad80dc0d74119b2a9cd5c1935e8d5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e5bad80dc0d74119b2a9cd5c1935e8d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 17 03:18:20.724095 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Tenant: tempest-AttachVolumeTestJSON-1921657918 Oct 17 03:18:20.724095 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Tenant-Id: e5bad80dc0d74119b2a9cd5c1935e8d5 Oct 17 03:18:20.724095 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1921657918 Oct 17 03:18:20.724095 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-User: tempest-AttachVolumeTestJSON-1921657918-project Oct 17 03:18:20.724095 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-User-Domain-Id: default Oct 17 03:18:20.724095 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-User-Domain-Name: Default Oct 17 03:18:20.724095 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-User-Id: ce25db99a7b14d0bbaca41fff80e3da9 Oct 17 03:18:20.724095 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-User-Name: tempest-AttachVolumeTestJSON-1921657918-project Oct 17 03:18:20.724095 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: method: > Oct 17 03:18:20.724095 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: exception: Instance b63b8f22-1f05-418e-b804-010e3d5cd2ae could not be found. Oct 17 03:18:20.724095 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: action_args: {'id': 'b63b8f22-1f05-418e-b804-010e3d5cd2ae'} Oct 17 03:18:20.724975 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 03:18:20.724975 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:18:20.724975 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 03:18:20.724975 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 03:18:20.724975 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 03:18:20.724975 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 03:18:20.724975 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 03:18:20.724975 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 03:18:20.724975 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 03:18:20.724975 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 03:18:20.724975 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b63b8f22-1f05-418e-b804-010e3d5cd2ae could not be found. Oct 17 03:18:20.724975 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Oct 17 03:18:20.724975 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:18:20.724975 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Oct 17 03:18:20.724975 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:18:20.724975 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:18:20.724975 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:18:20.724975 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 03:18:20.724975 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 03:18:20.724975 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 03:18:20.726350 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 03:18:20.726350 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 03:18:20.726350 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 03:18:20.726350 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 03:18:20.726350 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 03:18:20.726350 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 03:18:20.726350 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 03:18:20.726350 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 03:18:20.726350 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 03:18:20.726350 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b63b8f22-1f05-418e-b804-010e3d5cd2ae could not be found. Oct 17 03:18:20.726350 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Oct 17 03:18:20.726350 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:18:20.726350 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Oct 17 03:18:20.726350 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:18:20.726350 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:18:20.726350 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:18:20.726350 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 03:18:20.726350 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 03:18:20.726350 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b63b8f22-1f05-418e-b804-010e3d5cd2ae could not be found. Oct 17 03:18:20.726350 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Oct 17 03:18:20.728576 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-57af0ef6-eea9-4020-9ba3-18fcfc21882a tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Returning 404 to user: Instance b63b8f22-1f05-418e-b804-010e3d5cd2ae could not be found. {{(pid=118887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 03:18:20.728576 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-57af0ef6-eea9-4020-9ba3-18fcfc21882a tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] 10.222.0.27 "DELETE /compute/v2.1/servers/b63b8f22-1f05-418e-b804-010e3d5cd2ae" status: 404 len: 111 microversion: 2.1 time: 0.031615 Oct 17 03:18:20.728576 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 400/834] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 03:18:20 2022] DELETE /compute/v2.1/servers/b63b8f22-1f05-418e-b804-010e3d5cd2ae => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 03:18:20.733107 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-d59827e0-712f-4c17-8ae8-7f200dfc279a tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:18:20.733704 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-d59827e0-712f-4c17-8ae8-7f200dfc279a tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] [instance: b63b8f22-1f05-418e-b804-010e3d5cd2ae] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:18:20.736577 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.wsgi [None req-af5ed120-ced7-42b8-8571-67dc66eb8d63 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] HTTP exception thrown: Instance d521fa69-4f04-4d79-8a81-22b2e4bafbae could not be found. Oct 17 03:18:20.738405 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-af5ed120-ced7-42b8-8571-67dc66eb8d63 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Request method failure captured: Oct 17 03:18:20.738405 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: request: GET /compute/v2.1/servers/d521fa69-4f04-4d79-8a81-22b2e4bafbae HTTP/1.1 Oct 17 03:18:20.738405 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Accept: application/json Oct 17 03:18:20.738405 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Accept-Encoding: identity Oct 17 03:18:20.738405 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Connection: close Oct 17 03:18:20.738405 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Content-Length: 0 Oct 17 03:18:20.738405 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Content-Type: application/json Oct 17 03:18:20.738405 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Host: 10.222.0.27 Oct 17 03:18:20.738405 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Openstack-System-Scope: None Oct 17 03:18:20.738405 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: User-Agent: python-urllib3/1.26.12 Oct 17 03:18:20.738405 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Auth-Token: gAAAAABjTMf-SpDw6REUqxlSOIvhtlgFxCyi7gugHXw9249WtXgpgYG8a0yyM9JbvLErgztKU1aaT378mlFtg9Uhrjdru2uD9-W4FJ-CkFLSVPWuyDvIf6q3m3rDvz5qZHkGg2K6V9p96rkOt2BGqAhrNrGmStKoZpndwIVbln6Rg2eRSFSEBDA Oct 17 03:18:20.738405 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Domain-Id: None Oct 17 03:18:20.738405 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Domain-Name: None Oct 17 03:18:20.738405 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Identity-Status: Confirmed Oct 17 03:18:20.738405 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Is-Admin-Project: True Oct 17 03:18:20.738405 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Project-Domain-Id: default Oct 17 03:18:20.738405 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Project-Domain-Name: Default Oct 17 03:18:20.738405 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Project-Id: 618cf0b3507845909bb27c13460d1d6c Oct 17 03:18:20.738405 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Project-Name: tempest-AttachVolumeNegativeTest-816799241 Oct 17 03:18:20.738405 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Role: member,reader Oct 17 03:18:20.738405 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Roles: member,reader Oct 17 03:18:20.741008 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/618cf0b3507845909bb27c13460d1d6c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/618cf0b3507845909bb27c13460d1d6c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/618cf0b3507845909bb27c13460d1d6c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_618cf0b3507845909bb27c13460d1d6c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 17 03:18:20.741008 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Tenant: tempest-AttachVolumeNegativeTest-816799241 Oct 17 03:18:20.741008 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Tenant-Id: 618cf0b3507845909bb27c13460d1d6c Oct 17 03:18:20.741008 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-816799241 Oct 17 03:18:20.741008 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-User: tempest-AttachVolumeNegativeTest-816799241-project Oct 17 03:18:20.741008 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-User-Domain-Id: default Oct 17 03:18:20.741008 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-User-Domain-Name: Default Oct 17 03:18:20.741008 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-User-Id: 1c786544e8fb4e8e8c3a4990a0f36725 Oct 17 03:18:20.741008 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-User-Name: tempest-AttachVolumeNegativeTest-816799241-project Oct 17 03:18:20.741008 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: method: > Oct 17 03:18:20.741008 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: exception: Instance d521fa69-4f04-4d79-8a81-22b2e4bafbae could not be found. Oct 17 03:18:20.741008 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: action_args: {'id': 'd521fa69-4f04-4d79-8a81-22b2e4bafbae'} Oct 17 03:18:20.742463 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 03:18:20.742463 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:18:20.742463 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 03:18:20.742463 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 03:18:20.742463 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 03:18:20.742463 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 03:18:20.742463 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 03:18:20.742463 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 03:18:20.742463 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 03:18:20.742463 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 03:18:20.742463 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d521fa69-4f04-4d79-8a81-22b2e4bafbae could not be found. Oct 17 03:18:20.742463 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Oct 17 03:18:20.742463 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:18:20.742463 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Oct 17 03:18:20.742463 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:18:20.742463 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:18:20.742463 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:18:20.742463 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 03:18:20.742463 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 03:18:20.742463 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 03:18:20.744891 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 03:18:20.744891 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 03:18:20.744891 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 03:18:20.744891 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 03:18:20.744891 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 03:18:20.744891 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 03:18:20.744891 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 03:18:20.744891 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d521fa69-4f04-4d79-8a81-22b2e4bafbae could not be found. Oct 17 03:18:20.744891 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Oct 17 03:18:20.744891 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:18:20.744891 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Oct 17 03:18:20.744891 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:18:20.744891 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:18:20.744891 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:18:20.744891 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 03:18:20.744891 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 03:18:20.744891 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d521fa69-4f04-4d79-8a81-22b2e4bafbae could not be found. Oct 17 03:18:20.744891 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Oct 17 03:18:20.747592 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-af5ed120-ced7-42b8-8571-67dc66eb8d63 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Returning 404 to user: Instance d521fa69-4f04-4d79-8a81-22b2e4bafbae could not be found. {{(pid=118886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 03:18:20.747776 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-d59827e0-712f-4c17-8ae8-7f200dfc279a tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:18:20.747776 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-d59827e0-712f-4c17-8ae8-7f200dfc279a tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:18:20.747776 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-d59827e0-712f-4c17-8ae8-7f200dfc279a tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:18:20.747776 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-d59827e0-712f-4c17-8ae8-7f200dfc279a tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:18:20.748319 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-d59827e0-712f-4c17-8ae8-7f200dfc279a tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:18:20.748460 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-af5ed120-ced7-42b8-8571-67dc66eb8d63 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] 10.222.0.27 "GET /compute/v2.1/servers/d521fa69-4f04-4d79-8a81-22b2e4bafbae" status: 404 len: 111 microversion: 2.1 time: 0.031475 Oct 17 03:18:20.748595 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-d59827e0-712f-4c17-8ae8-7f200dfc279a tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:18:20.748733 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 435/835] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:18:20 2022] GET /compute/v2.1/servers/d521fa69-4f04-4d79-8a81-22b2e4bafbae => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 03:18:20.752078 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-dea73909-084f-4418-b680-f5d4a0abeb51 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:18:20.752562 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-dea73909-084f-4418-b680-f5d4a0abeb51 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] [instance: d834c830-cb7f-43ce-ac79-2bf168e8f664] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:18:20.758314 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-dea73909-084f-4418-b680-f5d4a0abeb51 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:18:20.758571 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.wsgi [None req-d59827e0-712f-4c17-8ae8-7f200dfc279a tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] HTTP exception thrown: Instance b63b8f22-1f05-418e-b804-010e3d5cd2ae could not be found. Oct 17 03:18:20.759079 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-dea73909-084f-4418-b680-f5d4a0abeb51 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:18:20.759542 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-dea73909-084f-4418-b680-f5d4a0abeb51 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:18:20.760203 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-dea73909-084f-4418-b680-f5d4a0abeb51 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:18:20.760652 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-dea73909-084f-4418-b680-f5d4a0abeb51 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:18:20.760863 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-d59827e0-712f-4c17-8ae8-7f200dfc279a tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Request method failure captured: Oct 17 03:18:20.760863 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: request: GET /compute/v2.1/servers/b63b8f22-1f05-418e-b804-010e3d5cd2ae HTTP/1.1 Oct 17 03:18:20.760863 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Accept: application/json Oct 17 03:18:20.760863 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Accept-Encoding: identity Oct 17 03:18:20.760863 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Connection: close Oct 17 03:18:20.760863 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Content-Length: 0 Oct 17 03:18:20.760863 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Content-Type: application/json Oct 17 03:18:20.760863 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Host: 10.222.0.27 Oct 17 03:18:20.760863 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Openstack-System-Scope: None Oct 17 03:18:20.760863 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: User-Agent: python-urllib3/1.26.12 Oct 17 03:18:20.760863 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Auth-Token: gAAAAABjTMf8JV6UANmoo3RCAe3xHSgPfZQVEBdFiPOEb_yO9Ct8ESAfEcnl03KATLNHNncGiIS4w8OY6GoKRN1y8W0XRxZTqKeCFzVtwZG7Bj3lhhKwcXkyi4Qg3fTqOg5f9fTHbmt5uLBux2T8UAxLVbxjUk77x2aNLLIBADgWKyi7sbgIkng Oct 17 03:18:20.760863 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Domain-Id: None Oct 17 03:18:20.760863 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Domain-Name: None Oct 17 03:18:20.760863 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Identity-Status: Confirmed Oct 17 03:18:20.760863 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Is-Admin-Project: True Oct 17 03:18:20.760863 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Project-Domain-Id: default Oct 17 03:18:20.760863 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Project-Domain-Name: Default Oct 17 03:18:20.760863 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Project-Id: e5bad80dc0d74119b2a9cd5c1935e8d5 Oct 17 03:18:20.760863 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Project-Name: tempest-AttachVolumeTestJSON-1921657918 Oct 17 03:18:20.760863 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Role: member,reader Oct 17 03:18:20.760863 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Roles: member,reader Oct 17 03:18:20.763695 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e5bad80dc0d74119b2a9cd5c1935e8d5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e5bad80dc0d74119b2a9cd5c1935e8d5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e5bad80dc0d74119b2a9cd5c1935e8d5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e5bad80dc0d74119b2a9cd5c1935e8d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 17 03:18:20.763695 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Tenant: tempest-AttachVolumeTestJSON-1921657918 Oct 17 03:18:20.763695 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Tenant-Id: e5bad80dc0d74119b2a9cd5c1935e8d5 Oct 17 03:18:20.763695 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1921657918 Oct 17 03:18:20.763695 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-User: tempest-AttachVolumeTestJSON-1921657918-project Oct 17 03:18:20.763695 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-User-Domain-Id: default Oct 17 03:18:20.763695 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-User-Domain-Name: Default Oct 17 03:18:20.763695 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-User-Id: ce25db99a7b14d0bbaca41fff80e3da9 Oct 17 03:18:20.763695 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-User-Name: tempest-AttachVolumeTestJSON-1921657918-project Oct 17 03:18:20.763695 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: method: > Oct 17 03:18:20.763695 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: exception: Instance b63b8f22-1f05-418e-b804-010e3d5cd2ae could not be found. Oct 17 03:18:20.763695 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: action_args: {'id': 'b63b8f22-1f05-418e-b804-010e3d5cd2ae'} Oct 17 03:18:20.765176 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 03:18:20.765176 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:18:20.765176 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 03:18:20.765176 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 03:18:20.765176 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 03:18:20.765176 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 03:18:20.765176 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 03:18:20.765176 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 03:18:20.765176 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 03:18:20.765176 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 03:18:20.765176 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b63b8f22-1f05-418e-b804-010e3d5cd2ae could not be found. Oct 17 03:18:20.765176 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Oct 17 03:18:20.765176 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:18:20.765176 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Oct 17 03:18:20.765176 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:18:20.765176 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:18:20.765176 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:18:20.765176 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 03:18:20.765176 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 03:18:20.765176 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 03:18:20.768232 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 03:18:20.768232 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 03:18:20.768232 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 03:18:20.768232 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 03:18:20.768232 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 03:18:20.768232 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 03:18:20.768232 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 03:18:20.768232 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b63b8f22-1f05-418e-b804-010e3d5cd2ae could not be found. Oct 17 03:18:20.768232 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Oct 17 03:18:20.768232 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:18:20.768232 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Oct 17 03:18:20.768232 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:18:20.768232 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:18:20.768232 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:18:20.768232 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 03:18:20.768232 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 03:18:20.768232 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b63b8f22-1f05-418e-b804-010e3d5cd2ae could not be found. Oct 17 03:18:20.768232 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Oct 17 03:18:20.770510 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-dea73909-084f-4418-b680-f5d4a0abeb51 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:18:20.770654 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-d59827e0-712f-4c17-8ae8-7f200dfc279a tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Returning 404 to user: Instance b63b8f22-1f05-418e-b804-010e3d5cd2ae could not be found. {{(pid=118887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 03:18:20.770654 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-d59827e0-712f-4c17-8ae8-7f200dfc279a tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] 10.222.0.27 "GET /compute/v2.1/servers/b63b8f22-1f05-418e-b804-010e3d5cd2ae" status: 404 len: 111 microversion: 2.1 time: 0.032665 Oct 17 03:18:20.770654 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 401/836] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:18:20 2022] GET /compute/v2.1/servers/b63b8f22-1f05-418e-b804-010e3d5cd2ae => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 03:18:20.776138 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.wsgi [None req-dea73909-084f-4418-b680-f5d4a0abeb51 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] HTTP exception thrown: Instance d834c830-cb7f-43ce-ac79-2bf168e8f664 could not be found. Oct 17 03:18:20.777969 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-dea73909-084f-4418-b680-f5d4a0abeb51 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Request method failure captured: Oct 17 03:18:20.777969 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: request: DELETE /compute/v2.1/servers/d834c830-cb7f-43ce-ac79-2bf168e8f664 HTTP/1.1 Oct 17 03:18:20.777969 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Accept: application/json Oct 17 03:18:20.777969 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Accept-Encoding: identity Oct 17 03:18:20.777969 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Connection: close Oct 17 03:18:20.777969 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Content-Length: 0 Oct 17 03:18:20.777969 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Content-Type: application/json Oct 17 03:18:20.777969 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Host: 10.222.0.27 Oct 17 03:18:20.777969 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Openstack-System-Scope: None Oct 17 03:18:20.777969 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: User-Agent: python-urllib3/1.26.12 Oct 17 03:18:20.777969 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Auth-Token: gAAAAABjTMf-SpDw6REUqxlSOIvhtlgFxCyi7gugHXw9249WtXgpgYG8a0yyM9JbvLErgztKU1aaT378mlFtg9Uhrjdru2uD9-W4FJ-CkFLSVPWuyDvIf6q3m3rDvz5qZHkGg2K6V9p96rkOt2BGqAhrNrGmStKoZpndwIVbln6Rg2eRSFSEBDA Oct 17 03:18:20.777969 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Domain-Id: None Oct 17 03:18:20.777969 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Domain-Name: None Oct 17 03:18:20.777969 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Identity-Status: Confirmed Oct 17 03:18:20.777969 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Is-Admin-Project: True Oct 17 03:18:20.777969 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Project-Domain-Id: default Oct 17 03:18:20.777969 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Project-Domain-Name: Default Oct 17 03:18:20.777969 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Project-Id: 618cf0b3507845909bb27c13460d1d6c Oct 17 03:18:20.777969 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Project-Name: tempest-AttachVolumeNegativeTest-816799241 Oct 17 03:18:20.777969 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Role: member,reader Oct 17 03:18:20.777969 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Roles: member,reader Oct 17 03:18:20.779372 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/618cf0b3507845909bb27c13460d1d6c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/618cf0b3507845909bb27c13460d1d6c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/618cf0b3507845909bb27c13460d1d6c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_618cf0b3507845909bb27c13460d1d6c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 17 03:18:20.779372 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Tenant: tempest-AttachVolumeNegativeTest-816799241 Oct 17 03:18:20.779372 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Tenant-Id: 618cf0b3507845909bb27c13460d1d6c Oct 17 03:18:20.779372 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-816799241 Oct 17 03:18:20.779372 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-User: tempest-AttachVolumeNegativeTest-816799241-project Oct 17 03:18:20.779372 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-User-Domain-Id: default Oct 17 03:18:20.779372 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-User-Domain-Name: Default Oct 17 03:18:20.779372 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-User-Id: 1c786544e8fb4e8e8c3a4990a0f36725 Oct 17 03:18:20.779372 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-User-Name: tempest-AttachVolumeNegativeTest-816799241-project Oct 17 03:18:20.779372 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: method: > Oct 17 03:18:20.779372 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: exception: Instance d834c830-cb7f-43ce-ac79-2bf168e8f664 could not be found. Oct 17 03:18:20.779372 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: action_args: {'id': 'd834c830-cb7f-43ce-ac79-2bf168e8f664'} Oct 17 03:18:20.780088 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 03:18:20.780088 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:18:20.780088 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 03:18:20.780088 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 03:18:20.780088 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 03:18:20.780088 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 03:18:20.780088 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 03:18:20.780088 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 03:18:20.780088 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 03:18:20.780088 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 03:18:20.780088 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d834c830-cb7f-43ce-ac79-2bf168e8f664 could not be found. Oct 17 03:18:20.780088 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Oct 17 03:18:20.780088 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:18:20.780088 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Oct 17 03:18:20.780088 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:18:20.780088 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:18:20.780088 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:18:20.780088 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 03:18:20.780088 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 03:18:20.780088 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 03:18:20.781274 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 03:18:20.781274 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 03:18:20.781274 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 03:18:20.781274 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 03:18:20.781274 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 03:18:20.781274 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 03:18:20.781274 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 03:18:20.781274 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 03:18:20.781274 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 03:18:20.781274 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d834c830-cb7f-43ce-ac79-2bf168e8f664 could not be found. Oct 17 03:18:20.781274 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Oct 17 03:18:20.781274 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:18:20.781274 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Oct 17 03:18:20.781274 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:18:20.781274 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:18:20.781274 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:18:20.781274 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 03:18:20.781274 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 03:18:20.781274 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d834c830-cb7f-43ce-ac79-2bf168e8f664 could not be found. Oct 17 03:18:20.781274 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Oct 17 03:18:20.782454 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-dea73909-084f-4418-b680-f5d4a0abeb51 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Returning 404 to user: Instance d834c830-cb7f-43ce-ac79-2bf168e8f664 could not be found. {{(pid=118886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 03:18:20.782901 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-dea73909-084f-4418-b680-f5d4a0abeb51 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] 10.222.0.27 "DELETE /compute/v2.1/servers/d834c830-cb7f-43ce-ac79-2bf168e8f664" status: 404 len: 111 microversion: 2.1 time: 0.034489 Oct 17 03:18:20.783460 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 436/837] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 03:18:20 2022] DELETE /compute/v2.1/servers/d834c830-cb7f-43ce-ac79-2bf168e8f664 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 03:18:20.792209 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-548dc9ea-55fb-4a7a-8b8a-f151779a43de tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:18:20.792810 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-548dc9ea-55fb-4a7a-8b8a-f151779a43de tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] [instance: d834c830-cb7f-43ce-ac79-2bf168e8f664] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:18:20.798681 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-548dc9ea-55fb-4a7a-8b8a-f151779a43de tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:18:20.799189 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-548dc9ea-55fb-4a7a-8b8a-f151779a43de tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:18:20.799619 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-548dc9ea-55fb-4a7a-8b8a-f151779a43de tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:18:20.800301 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-548dc9ea-55fb-4a7a-8b8a-f151779a43de tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:18:20.800746 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-548dc9ea-55fb-4a7a-8b8a-f151779a43de tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:18:20.801169 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-548dc9ea-55fb-4a7a-8b8a-f151779a43de tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:18:20.814964 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.wsgi [None req-548dc9ea-55fb-4a7a-8b8a-f151779a43de tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] HTTP exception thrown: Instance d834c830-cb7f-43ce-ac79-2bf168e8f664 could not be found. Oct 17 03:18:20.816612 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-548dc9ea-55fb-4a7a-8b8a-f151779a43de tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Request method failure captured: Oct 17 03:18:20.816612 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: request: GET /compute/v2.1/servers/d834c830-cb7f-43ce-ac79-2bf168e8f664 HTTP/1.1 Oct 17 03:18:20.816612 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Accept: application/json Oct 17 03:18:20.816612 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Accept-Encoding: identity Oct 17 03:18:20.816612 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Connection: close Oct 17 03:18:20.816612 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Content-Length: 0 Oct 17 03:18:20.816612 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Content-Type: application/json Oct 17 03:18:20.816612 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Host: 10.222.0.27 Oct 17 03:18:20.816612 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Openstack-System-Scope: None Oct 17 03:18:20.816612 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: User-Agent: python-urllib3/1.26.12 Oct 17 03:18:20.816612 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Auth-Token: gAAAAABjTMf-SpDw6REUqxlSOIvhtlgFxCyi7gugHXw9249WtXgpgYG8a0yyM9JbvLErgztKU1aaT378mlFtg9Uhrjdru2uD9-W4FJ-CkFLSVPWuyDvIf6q3m3rDvz5qZHkGg2K6V9p96rkOt2BGqAhrNrGmStKoZpndwIVbln6Rg2eRSFSEBDA Oct 17 03:18:20.816612 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Domain-Id: None Oct 17 03:18:20.816612 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Domain-Name: None Oct 17 03:18:20.816612 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Identity-Status: Confirmed Oct 17 03:18:20.816612 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Is-Admin-Project: True Oct 17 03:18:20.816612 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Project-Domain-Id: default Oct 17 03:18:20.816612 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Project-Domain-Name: Default Oct 17 03:18:20.816612 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Project-Id: 618cf0b3507845909bb27c13460d1d6c Oct 17 03:18:20.816612 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Project-Name: tempest-AttachVolumeNegativeTest-816799241 Oct 17 03:18:20.816612 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Role: member,reader Oct 17 03:18:20.816612 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Roles: member,reader Oct 17 03:18:20.818077 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/618cf0b3507845909bb27c13460d1d6c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/618cf0b3507845909bb27c13460d1d6c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/618cf0b3507845909bb27c13460d1d6c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_618cf0b3507845909bb27c13460d1d6c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 17 03:18:20.818077 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Tenant: tempest-AttachVolumeNegativeTest-816799241 Oct 17 03:18:20.818077 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Tenant-Id: 618cf0b3507845909bb27c13460d1d6c Oct 17 03:18:20.818077 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-816799241 Oct 17 03:18:20.818077 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-User: tempest-AttachVolumeNegativeTest-816799241-project Oct 17 03:18:20.818077 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-User-Domain-Id: default Oct 17 03:18:20.818077 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-User-Domain-Name: Default Oct 17 03:18:20.818077 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-User-Id: 1c786544e8fb4e8e8c3a4990a0f36725 Oct 17 03:18:20.818077 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-User-Name: tempest-AttachVolumeNegativeTest-816799241-project Oct 17 03:18:20.818077 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: method: > Oct 17 03:18:20.818077 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: exception: Instance d834c830-cb7f-43ce-ac79-2bf168e8f664 could not be found. Oct 17 03:18:20.818077 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: action_args: {'id': 'd834c830-cb7f-43ce-ac79-2bf168e8f664'} Oct 17 03:18:20.818825 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 03:18:20.818825 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:18:20.818825 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 03:18:20.818825 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 03:18:20.818825 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 03:18:20.818825 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 03:18:20.818825 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 03:18:20.818825 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 03:18:20.818825 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 03:18:20.818825 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 03:18:20.818825 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d834c830-cb7f-43ce-ac79-2bf168e8f664 could not be found. Oct 17 03:18:20.818825 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Oct 17 03:18:20.818825 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:18:20.818825 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Oct 17 03:18:20.818825 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:18:20.818825 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:18:20.818825 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:18:20.818825 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 03:18:20.818825 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 03:18:20.818825 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 03:18:20.820229 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 03:18:20.820229 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 03:18:20.820229 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 03:18:20.820229 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 03:18:20.820229 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 03:18:20.820229 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 03:18:20.820229 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 03:18:20.820229 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d834c830-cb7f-43ce-ac79-2bf168e8f664 could not be found. Oct 17 03:18:20.820229 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Oct 17 03:18:20.820229 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:18:20.820229 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Oct 17 03:18:20.820229 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:18:20.820229 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:18:20.820229 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:18:20.820229 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 03:18:20.820229 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 03:18:20.820229 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d834c830-cb7f-43ce-ac79-2bf168e8f664 could not be found. Oct 17 03:18:20.820229 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Oct 17 03:18:20.821317 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-548dc9ea-55fb-4a7a-8b8a-f151779a43de tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Returning 404 to user: Instance d834c830-cb7f-43ce-ac79-2bf168e8f664 could not be found. {{(pid=118887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 03:18:20.821317 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-548dc9ea-55fb-4a7a-8b8a-f151779a43de tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] 10.222.0.27 "GET /compute/v2.1/servers/d834c830-cb7f-43ce-ac79-2bf168e8f664" status: 404 len: 111 microversion: 2.1 time: 0.030113 Oct 17 03:18:20.821317 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 402/838] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:18:20 2022] GET /compute/v2.1/servers/d834c830-cb7f-43ce-ac79-2bf168e8f664 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 03:18:21.906213 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-8d62fedd-80ea-4590-9fc3-38a4957af18f tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:18:21.906756 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-8d62fedd-80ea-4590-9fc3-38a4957af18f tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] [instance: 7b220b35-d9ac-48e4-b898-3d4f6c7be835] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:18:21.913366 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-8d62fedd-80ea-4590-9fc3-38a4957af18f tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:18:21.913863 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-8d62fedd-80ea-4590-9fc3-38a4957af18f tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:18:21.914302 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-8d62fedd-80ea-4590-9fc3-38a4957af18f tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:18:21.915049 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-8d62fedd-80ea-4590-9fc3-38a4957af18f tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:18:21.915509 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-8d62fedd-80ea-4590-9fc3-38a4957af18f tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:18:21.915934 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-8d62fedd-80ea-4590-9fc3-38a4957af18f tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:18:21.929795 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.wsgi [None req-8d62fedd-80ea-4590-9fc3-38a4957af18f tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] HTTP exception thrown: Instance 7b220b35-d9ac-48e4-b898-3d4f6c7be835 could not be found. Oct 17 03:18:21.931358 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-8d62fedd-80ea-4590-9fc3-38a4957af18f tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Request method failure captured: Oct 17 03:18:21.931358 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: request: DELETE /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835 HTTP/1.1 Oct 17 03:18:21.931358 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Accept: application/json Oct 17 03:18:21.931358 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Accept-Encoding: identity Oct 17 03:18:21.931358 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Connection: close Oct 17 03:18:21.931358 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Content-Length: 0 Oct 17 03:18:21.931358 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Content-Type: application/json Oct 17 03:18:21.931358 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Host: 10.222.0.27 Oct 17 03:18:21.931358 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Openstack-System-Scope: None Oct 17 03:18:21.931358 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: User-Agent: python-urllib3/1.26.12 Oct 17 03:18:21.931358 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Auth-Token: gAAAAABjTMf8JV6UANmoo3RCAe3xHSgPfZQVEBdFiPOEb_yO9Ct8ESAfEcnl03KATLNHNncGiIS4w8OY6GoKRN1y8W0XRxZTqKeCFzVtwZG7Bj3lhhKwcXkyi4Qg3fTqOg5f9fTHbmt5uLBux2T8UAxLVbxjUk77x2aNLLIBADgWKyi7sbgIkng Oct 17 03:18:21.931358 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Domain-Id: None Oct 17 03:18:21.931358 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Domain-Name: None Oct 17 03:18:21.931358 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Identity-Status: Confirmed Oct 17 03:18:21.931358 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Is-Admin-Project: True Oct 17 03:18:21.931358 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Project-Domain-Id: default Oct 17 03:18:21.931358 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Project-Domain-Name: Default Oct 17 03:18:21.931358 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Project-Id: e5bad80dc0d74119b2a9cd5c1935e8d5 Oct 17 03:18:21.931358 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Project-Name: tempest-AttachVolumeTestJSON-1921657918 Oct 17 03:18:21.931358 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Role: member,reader Oct 17 03:18:21.931358 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Roles: member,reader Oct 17 03:18:21.932965 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e5bad80dc0d74119b2a9cd5c1935e8d5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e5bad80dc0d74119b2a9cd5c1935e8d5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e5bad80dc0d74119b2a9cd5c1935e8d5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e5bad80dc0d74119b2a9cd5c1935e8d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 17 03:18:21.932965 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Tenant: tempest-AttachVolumeTestJSON-1921657918 Oct 17 03:18:21.932965 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Tenant-Id: e5bad80dc0d74119b2a9cd5c1935e8d5 Oct 17 03:18:21.932965 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1921657918 Oct 17 03:18:21.932965 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-User: tempest-AttachVolumeTestJSON-1921657918-project Oct 17 03:18:21.932965 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-User-Domain-Id: default Oct 17 03:18:21.932965 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-User-Domain-Name: Default Oct 17 03:18:21.932965 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-User-Id: ce25db99a7b14d0bbaca41fff80e3da9 Oct 17 03:18:21.932965 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-User-Name: tempest-AttachVolumeTestJSON-1921657918-project Oct 17 03:18:21.932965 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: method: > Oct 17 03:18:21.932965 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: exception: Instance 7b220b35-d9ac-48e4-b898-3d4f6c7be835 could not be found. Oct 17 03:18:21.932965 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: action_args: {'id': '7b220b35-d9ac-48e4-b898-3d4f6c7be835'} Oct 17 03:18:21.933812 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 03:18:21.933812 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:18:21.933812 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 03:18:21.933812 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 03:18:21.933812 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 03:18:21.933812 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 03:18:21.933812 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 03:18:21.933812 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 03:18:21.933812 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 03:18:21.933812 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 03:18:21.933812 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b220b35-d9ac-48e4-b898-3d4f6c7be835 could not be found. Oct 17 03:18:21.933812 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Oct 17 03:18:21.933812 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:18:21.933812 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Oct 17 03:18:21.933812 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:18:21.933812 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:18:21.933812 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:18:21.933812 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 03:18:21.933812 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 03:18:21.933812 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 03:18:21.935201 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 03:18:21.935201 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 03:18:21.935201 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 03:18:21.935201 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 03:18:21.935201 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 03:18:21.935201 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 03:18:21.935201 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 03:18:21.935201 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 03:18:21.935201 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 03:18:21.935201 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b220b35-d9ac-48e4-b898-3d4f6c7be835 could not be found. Oct 17 03:18:21.935201 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Oct 17 03:18:21.935201 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:18:21.935201 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Oct 17 03:18:21.935201 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:18:21.935201 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:18:21.935201 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:18:21.935201 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 03:18:21.935201 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 03:18:21.935201 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b220b35-d9ac-48e4-b898-3d4f6c7be835 could not be found. Oct 17 03:18:21.935201 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Oct 17 03:18:21.936685 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-8d62fedd-80ea-4590-9fc3-38a4957af18f tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Returning 404 to user: Instance 7b220b35-d9ac-48e4-b898-3d4f6c7be835 could not be found. {{(pid=118886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 03:18:21.936685 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-8d62fedd-80ea-4590-9fc3-38a4957af18f tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] 10.222.0.27 "DELETE /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835" status: 404 len: 111 microversion: 2.1 time: 0.030289 Oct 17 03:18:21.936685 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 437/839] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 03:18:21 2022] DELETE /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 03:18:21.941475 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-e0059ab5-9b65-42e5-bd0c-8dc62d51df17 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:18:21.942078 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-e0059ab5-9b65-42e5-bd0c-8dc62d51df17 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] [instance: 7b220b35-d9ac-48e4-b898-3d4f6c7be835] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:18:21.949371 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-e0059ab5-9b65-42e5-bd0c-8dc62d51df17 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:18:21.949853 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-e0059ab5-9b65-42e5-bd0c-8dc62d51df17 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:18:21.950442 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-e0059ab5-9b65-42e5-bd0c-8dc62d51df17 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:18:21.951191 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-e0059ab5-9b65-42e5-bd0c-8dc62d51df17 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:18:21.951643 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-e0059ab5-9b65-42e5-bd0c-8dc62d51df17 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:18:21.952067 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-e0059ab5-9b65-42e5-bd0c-8dc62d51df17 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:18:21.967676 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.wsgi [None req-e0059ab5-9b65-42e5-bd0c-8dc62d51df17 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] HTTP exception thrown: Instance 7b220b35-d9ac-48e4-b898-3d4f6c7be835 could not be found. Oct 17 03:18:21.968774 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-43e6a93a-8cbb-400c-bb55-319193ed413f tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:18:21.969180 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-e0059ab5-9b65-42e5-bd0c-8dc62d51df17 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Request method failure captured: Oct 17 03:18:21.969180 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: request: GET /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835 HTTP/1.1 Oct 17 03:18:21.969180 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Accept: application/json Oct 17 03:18:21.969180 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Accept-Encoding: identity Oct 17 03:18:21.969180 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Connection: close Oct 17 03:18:21.969180 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Content-Length: 0 Oct 17 03:18:21.969180 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Content-Type: application/json Oct 17 03:18:21.969180 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Host: 10.222.0.27 Oct 17 03:18:21.969180 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Openstack-System-Scope: None Oct 17 03:18:21.969180 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: User-Agent: python-urllib3/1.26.12 Oct 17 03:18:21.969180 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Auth-Token: gAAAAABjTMf8JV6UANmoo3RCAe3xHSgPfZQVEBdFiPOEb_yO9Ct8ESAfEcnl03KATLNHNncGiIS4w8OY6GoKRN1y8W0XRxZTqKeCFzVtwZG7Bj3lhhKwcXkyi4Qg3fTqOg5f9fTHbmt5uLBux2T8UAxLVbxjUk77x2aNLLIBADgWKyi7sbgIkng Oct 17 03:18:21.969180 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Domain-Id: None Oct 17 03:18:21.969180 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Domain-Name: None Oct 17 03:18:21.969180 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Identity-Status: Confirmed Oct 17 03:18:21.969180 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Is-Admin-Project: True Oct 17 03:18:21.969180 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Project-Domain-Id: default Oct 17 03:18:21.969180 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Project-Domain-Name: Default Oct 17 03:18:21.969180 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Project-Id: e5bad80dc0d74119b2a9cd5c1935e8d5 Oct 17 03:18:21.969180 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Project-Name: tempest-AttachVolumeTestJSON-1921657918 Oct 17 03:18:21.969180 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Role: member,reader Oct 17 03:18:21.969180 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Roles: member,reader Oct 17 03:18:21.970750 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e5bad80dc0d74119b2a9cd5c1935e8d5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e5bad80dc0d74119b2a9cd5c1935e8d5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e5bad80dc0d74119b2a9cd5c1935e8d5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e5bad80dc0d74119b2a9cd5c1935e8d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 17 03:18:21.970750 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Tenant: tempest-AttachVolumeTestJSON-1921657918 Oct 17 03:18:21.970750 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Tenant-Id: e5bad80dc0d74119b2a9cd5c1935e8d5 Oct 17 03:18:21.970750 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1921657918 Oct 17 03:18:21.970750 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-User: tempest-AttachVolumeTestJSON-1921657918-project Oct 17 03:18:21.970750 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-User-Domain-Id: default Oct 17 03:18:21.970750 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-User-Domain-Name: Default Oct 17 03:18:21.970750 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-User-Id: ce25db99a7b14d0bbaca41fff80e3da9 Oct 17 03:18:21.970750 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-User-Name: tempest-AttachVolumeTestJSON-1921657918-project Oct 17 03:18:21.970750 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: method: > Oct 17 03:18:21.970750 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: exception: Instance 7b220b35-d9ac-48e4-b898-3d4f6c7be835 could not be found. Oct 17 03:18:21.970750 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: action_args: {'id': '7b220b35-d9ac-48e4-b898-3d4f6c7be835'} Oct 17 03:18:21.971586 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 03:18:21.971586 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:18:21.971586 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 03:18:21.971586 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 03:18:21.971586 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 03:18:21.971586 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 03:18:21.971586 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 03:18:21.971586 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 03:18:21.971586 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 03:18:21.971586 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 03:18:21.971586 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b220b35-d9ac-48e4-b898-3d4f6c7be835 could not be found. Oct 17 03:18:21.971586 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Oct 17 03:18:21.971586 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:18:21.971586 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Oct 17 03:18:21.971586 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:18:21.971586 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:18:21.971586 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:18:21.971586 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 03:18:21.971586 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 03:18:21.971586 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 03:18:21.972913 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 03:18:21.972913 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 03:18:21.972913 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 03:18:21.972913 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 03:18:21.972913 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 03:18:21.972913 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 03:18:21.972913 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 03:18:21.972913 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b220b35-d9ac-48e4-b898-3d4f6c7be835 could not be found. Oct 17 03:18:21.972913 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Oct 17 03:18:21.972913 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:18:21.972913 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Oct 17 03:18:21.972913 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:18:21.972913 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:18:21.972913 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:18:21.972913 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 03:18:21.972913 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 03:18:21.972913 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b220b35-d9ac-48e4-b898-3d4f6c7be835 could not be found. Oct 17 03:18:21.972913 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Oct 17 03:18:21.974201 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-43e6a93a-8cbb-400c-bb55-319193ed413f tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] [instance: 4fc83673-1557-4eb9-b80b-825364198d8a] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:18:21.974293 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-e0059ab5-9b65-42e5-bd0c-8dc62d51df17 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] Returning 404 to user: Instance 7b220b35-d9ac-48e4-b898-3d4f6c7be835 could not be found. {{(pid=118887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 03:18:21.974293 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-e0059ab5-9b65-42e5-bd0c-8dc62d51df17 tempest-AttachVolumeTestJSON-1921657918 tempest-AttachVolumeTestJSON-1921657918-project] 10.222.0.27 "GET /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835" status: 404 len: 111 microversion: 2.1 time: 0.033000 Oct 17 03:18:21.974293 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 403/840] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:18:21 2022] GET /compute/v2.1/servers/7b220b35-d9ac-48e4-b898-3d4f6c7be835 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 03:18:21.976552 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-43e6a93a-8cbb-400c-bb55-319193ed413f tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:18:21.977044 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-43e6a93a-8cbb-400c-bb55-319193ed413f tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:18:21.977531 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-43e6a93a-8cbb-400c-bb55-319193ed413f tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:18:21.978236 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-43e6a93a-8cbb-400c-bb55-319193ed413f tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:18:21.978693 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-43e6a93a-8cbb-400c-bb55-319193ed413f tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:18:21.979190 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-43e6a93a-8cbb-400c-bb55-319193ed413f tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:18:21.994095 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.wsgi [None req-43e6a93a-8cbb-400c-bb55-319193ed413f tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] HTTP exception thrown: Instance 4fc83673-1557-4eb9-b80b-825364198d8a could not be found. Oct 17 03:18:21.995963 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-43e6a93a-8cbb-400c-bb55-319193ed413f tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Request method failure captured: Oct 17 03:18:21.995963 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: request: DELETE /compute/v2.1/servers/4fc83673-1557-4eb9-b80b-825364198d8a HTTP/1.1 Oct 17 03:18:21.995963 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Accept: application/json Oct 17 03:18:21.995963 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Accept-Encoding: identity Oct 17 03:18:21.995963 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Connection: close Oct 17 03:18:21.995963 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Content-Length: 0 Oct 17 03:18:21.995963 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Content-Type: application/json Oct 17 03:18:21.995963 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Host: 10.222.0.27 Oct 17 03:18:21.995963 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Openstack-System-Scope: None Oct 17 03:18:21.995963 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: User-Agent: python-urllib3/1.26.12 Oct 17 03:18:21.995963 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Auth-Token: gAAAAABjTMf-SpDw6REUqxlSOIvhtlgFxCyi7gugHXw9249WtXgpgYG8a0yyM9JbvLErgztKU1aaT378mlFtg9Uhrjdru2uD9-W4FJ-CkFLSVPWuyDvIf6q3m3rDvz5qZHkGg2K6V9p96rkOt2BGqAhrNrGmStKoZpndwIVbln6Rg2eRSFSEBDA Oct 17 03:18:21.995963 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Domain-Id: None Oct 17 03:18:21.995963 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Domain-Name: None Oct 17 03:18:21.995963 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Identity-Status: Confirmed Oct 17 03:18:21.995963 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Is-Admin-Project: True Oct 17 03:18:21.995963 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Project-Domain-Id: default Oct 17 03:18:21.995963 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Project-Domain-Name: Default Oct 17 03:18:21.995963 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Project-Id: 618cf0b3507845909bb27c13460d1d6c Oct 17 03:18:21.995963 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Project-Name: tempest-AttachVolumeNegativeTest-816799241 Oct 17 03:18:21.995963 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Role: member,reader Oct 17 03:18:21.995963 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Roles: member,reader Oct 17 03:18:21.997665 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/618cf0b3507845909bb27c13460d1d6c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/618cf0b3507845909bb27c13460d1d6c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/618cf0b3507845909bb27c13460d1d6c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_618cf0b3507845909bb27c13460d1d6c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 17 03:18:21.997665 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Tenant: tempest-AttachVolumeNegativeTest-816799241 Oct 17 03:18:21.997665 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Tenant-Id: 618cf0b3507845909bb27c13460d1d6c Oct 17 03:18:21.997665 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-816799241 Oct 17 03:18:21.997665 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-User: tempest-AttachVolumeNegativeTest-816799241-project Oct 17 03:18:21.997665 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-User-Domain-Id: default Oct 17 03:18:21.997665 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-User-Domain-Name: Default Oct 17 03:18:21.997665 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-User-Id: 1c786544e8fb4e8e8c3a4990a0f36725 Oct 17 03:18:21.997665 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-User-Name: tempest-AttachVolumeNegativeTest-816799241-project Oct 17 03:18:21.997665 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: method: > Oct 17 03:18:21.997665 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: exception: Instance 4fc83673-1557-4eb9-b80b-825364198d8a could not be found. Oct 17 03:18:21.997665 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: action_args: {'id': '4fc83673-1557-4eb9-b80b-825364198d8a'} Oct 17 03:18:21.998647 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 03:18:21.998647 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:18:21.998647 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 03:18:21.998647 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 03:18:21.998647 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 03:18:21.998647 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 03:18:21.998647 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 03:18:21.998647 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 03:18:21.998647 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 03:18:21.998647 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 03:18:21.998647 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4fc83673-1557-4eb9-b80b-825364198d8a could not be found. Oct 17 03:18:21.998647 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Oct 17 03:18:21.998647 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:18:21.998647 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Oct 17 03:18:21.998647 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:18:21.998647 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:18:21.998647 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:18:21.998647 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 03:18:21.998647 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 03:18:21.998647 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 03:18:22.000446 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 03:18:22.000446 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 03:18:22.000446 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 03:18:22.000446 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 03:18:22.000446 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 03:18:22.000446 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 03:18:22.000446 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 03:18:22.000446 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 03:18:22.000446 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 03:18:22.000446 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4fc83673-1557-4eb9-b80b-825364198d8a could not be found. Oct 17 03:18:22.000446 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Oct 17 03:18:22.000446 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:18:22.000446 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Oct 17 03:18:22.000446 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:18:22.000446 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:18:22.000446 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:18:22.000446 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 03:18:22.000446 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 03:18:22.000446 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4fc83673-1557-4eb9-b80b-825364198d8a could not be found. Oct 17 03:18:22.000446 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Oct 17 03:18:22.001921 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-43e6a93a-8cbb-400c-bb55-319193ed413f tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Returning 404 to user: Instance 4fc83673-1557-4eb9-b80b-825364198d8a could not be found. {{(pid=118886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 03:18:22.001921 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-43e6a93a-8cbb-400c-bb55-319193ed413f tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] 10.222.0.27 "DELETE /compute/v2.1/servers/4fc83673-1557-4eb9-b80b-825364198d8a" status: 404 len: 111 microversion: 2.1 time: 0.032536 Oct 17 03:18:22.001921 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 438/841] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 03:18:21 2022] DELETE /compute/v2.1/servers/4fc83673-1557-4eb9-b80b-825364198d8a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 03:18:22.006697 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-095d4aa1-ae41-45c4-828f-435942d200c8 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:18:22.007326 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-095d4aa1-ae41-45c4-828f-435942d200c8 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] [instance: 4fc83673-1557-4eb9-b80b-825364198d8a] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:18:22.013733 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-095d4aa1-ae41-45c4-828f-435942d200c8 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:18:22.014200 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-095d4aa1-ae41-45c4-828f-435942d200c8 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:18:22.014626 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-095d4aa1-ae41-45c4-828f-435942d200c8 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:18:22.015331 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-095d4aa1-ae41-45c4-828f-435942d200c8 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:18:22.015778 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-095d4aa1-ae41-45c4-828f-435942d200c8 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:18:22.016193 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-095d4aa1-ae41-45c4-828f-435942d200c8 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:18:22.033470 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.wsgi [None req-095d4aa1-ae41-45c4-828f-435942d200c8 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] HTTP exception thrown: Instance 4fc83673-1557-4eb9-b80b-825364198d8a could not be found. Oct 17 03:18:22.038178 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-095d4aa1-ae41-45c4-828f-435942d200c8 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Request method failure captured: Oct 17 03:18:22.038178 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: request: GET /compute/v2.1/servers/4fc83673-1557-4eb9-b80b-825364198d8a HTTP/1.1 Oct 17 03:18:22.038178 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Accept: application/json Oct 17 03:18:22.038178 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Accept-Encoding: identity Oct 17 03:18:22.038178 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Connection: close Oct 17 03:18:22.038178 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Content-Length: 0 Oct 17 03:18:22.038178 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Content-Type: application/json Oct 17 03:18:22.038178 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Host: 10.222.0.27 Oct 17 03:18:22.038178 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Openstack-System-Scope: None Oct 17 03:18:22.038178 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: User-Agent: python-urllib3/1.26.12 Oct 17 03:18:22.038178 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Auth-Token: gAAAAABjTMf-SpDw6REUqxlSOIvhtlgFxCyi7gugHXw9249WtXgpgYG8a0yyM9JbvLErgztKU1aaT378mlFtg9Uhrjdru2uD9-W4FJ-CkFLSVPWuyDvIf6q3m3rDvz5qZHkGg2K6V9p96rkOt2BGqAhrNrGmStKoZpndwIVbln6Rg2eRSFSEBDA Oct 17 03:18:22.038178 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Domain-Id: None Oct 17 03:18:22.038178 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Domain-Name: None Oct 17 03:18:22.038178 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Identity-Status: Confirmed Oct 17 03:18:22.038178 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Is-Admin-Project: True Oct 17 03:18:22.038178 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Project-Domain-Id: default Oct 17 03:18:22.038178 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Project-Domain-Name: Default Oct 17 03:18:22.038178 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Project-Id: 618cf0b3507845909bb27c13460d1d6c Oct 17 03:18:22.038178 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Project-Name: tempest-AttachVolumeNegativeTest-816799241 Oct 17 03:18:22.038178 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Role: member,reader Oct 17 03:18:22.038178 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Roles: member,reader Oct 17 03:18:22.039840 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/618cf0b3507845909bb27c13460d1d6c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/618cf0b3507845909bb27c13460d1d6c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/618cf0b3507845909bb27c13460d1d6c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_618cf0b3507845909bb27c13460d1d6c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 17 03:18:22.039840 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Tenant: tempest-AttachVolumeNegativeTest-816799241 Oct 17 03:18:22.039840 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Tenant-Id: 618cf0b3507845909bb27c13460d1d6c Oct 17 03:18:22.039840 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-816799241 Oct 17 03:18:22.039840 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-User: tempest-AttachVolumeNegativeTest-816799241-project Oct 17 03:18:22.039840 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-User-Domain-Id: default Oct 17 03:18:22.039840 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-User-Domain-Name: Default Oct 17 03:18:22.039840 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-User-Id: 1c786544e8fb4e8e8c3a4990a0f36725 Oct 17 03:18:22.039840 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-User-Name: tempest-AttachVolumeNegativeTest-816799241-project Oct 17 03:18:22.039840 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: method: > Oct 17 03:18:22.039840 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: exception: Instance 4fc83673-1557-4eb9-b80b-825364198d8a could not be found. Oct 17 03:18:22.039840 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: action_args: {'id': '4fc83673-1557-4eb9-b80b-825364198d8a'} Oct 17 03:18:22.040711 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 03:18:22.040711 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:18:22.040711 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 03:18:22.040711 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 03:18:22.040711 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 03:18:22.040711 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 03:18:22.040711 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 03:18:22.040711 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 03:18:22.040711 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 03:18:22.040711 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 03:18:22.040711 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4fc83673-1557-4eb9-b80b-825364198d8a could not be found. Oct 17 03:18:22.040711 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Oct 17 03:18:22.040711 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:18:22.040711 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Oct 17 03:18:22.040711 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:18:22.040711 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:18:22.040711 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:18:22.040711 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 03:18:22.040711 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 03:18:22.040711 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 03:18:22.042292 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 03:18:22.042292 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 03:18:22.042292 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 03:18:22.042292 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 03:18:22.042292 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 03:18:22.042292 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 03:18:22.042292 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 03:18:22.042292 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4fc83673-1557-4eb9-b80b-825364198d8a could not be found. Oct 17 03:18:22.042292 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Oct 17 03:18:22.042292 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:18:22.042292 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Oct 17 03:18:22.042292 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:18:22.042292 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:18:22.042292 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:18:22.042292 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 03:18:22.042292 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 03:18:22.042292 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4fc83673-1557-4eb9-b80b-825364198d8a could not be found. Oct 17 03:18:22.042292 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Oct 17 03:18:22.043505 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-095d4aa1-ae41-45c4-828f-435942d200c8 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] Returning 404 to user: Instance 4fc83673-1557-4eb9-b80b-825364198d8a could not be found. {{(pid=118887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 03:18:22.043505 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-095d4aa1-ae41-45c4-828f-435942d200c8 tempest-AttachVolumeNegativeTest-816799241 tempest-AttachVolumeNegativeTest-816799241-project] 10.222.0.27 "GET /compute/v2.1/servers/4fc83673-1557-4eb9-b80b-825364198d8a" status: 404 len: 111 microversion: 2.1 time: 0.037793 Oct 17 03:18:22.046894 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 404/842] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:18:22 2022] GET /compute/v2.1/servers/4fc83673-1557-4eb9-b80b-825364198d8a => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 03:18:30.892443 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-8ca5da2e-9ec1-4582-a9d5-8cc9c8c026c2 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:18:30.895559 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-8ca5da2e-9ec1-4582-a9d5-8cc9c8c026c2 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 78c535d2-a4ae-43ff-bf93-8c35dfb79876] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:18:30.899288 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG dbcounter [-] [118886] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1 {{(pid=118886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:18:30.905461 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-8ca5da2e-9ec1-4582-a9d5-8cc9c8c026c2 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:18:30.906143 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-8ca5da2e-9ec1-4582-a9d5-8cc9c8c026c2 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:18:30.906573 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-8ca5da2e-9ec1-4582-a9d5-8cc9c8c026c2 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:18:30.907566 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-8ca5da2e-9ec1-4582-a9d5-8cc9c8c026c2 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:18:30.908077 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-8ca5da2e-9ec1-4582-a9d5-8cc9c8c026c2 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:18:30.908877 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-8ca5da2e-9ec1-4582-a9d5-8cc9c8c026c2 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:18:30.943095 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-8ca5da2e-9ec1-4582-a9d5-8cc9c8c026c2 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "GET /compute/v2.1/servers/78c535d2-a4ae-43ff-bf93-8c35dfb79876/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.054592 Oct 17 03:18:30.943095 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 439/843] 10.222.0.27 () {60 vars in 1343 bytes} [Mon Oct 17 03:18:30 2022] GET /compute/v2.1/servers/78c535d2-a4ae-43ff-bf93-8c35dfb79876/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:18:31.020575 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-434a0c51-c7af-4859-a5f3-a5f291bdf736 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:18:31.025179 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-434a0c51-c7af-4859-a5f3-a5f291bdf736 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 78c535d2-a4ae-43ff-bf93-8c35dfb79876] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:18:31.047509 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-434a0c51-c7af-4859-a5f3-a5f291bdf736 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:18:31.048392 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-434a0c51-c7af-4859-a5f3-a5f291bdf736 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:18:31.049717 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-434a0c51-c7af-4859-a5f3-a5f291bdf736 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:18:31.050779 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-434a0c51-c7af-4859-a5f3-a5f291bdf736 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:18:31.051401 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-434a0c51-c7af-4859-a5f3-a5f291bdf736 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:18:31.053066 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-434a0c51-c7af-4859-a5f3-a5f291bdf736 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:18:31.086336 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-434a0c51-c7af-4859-a5f3-a5f291bdf736 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 78c535d2-a4ae-43ff-bf93-8c35dfb79876] Going to try to terminate instance {{(pid=118887) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 03:18:31.102709 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG dbcounter [-] [118887] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=118887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:18:31.249202 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-434a0c51-c7af-4859-a5f3-a5f291bdf736 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "DELETE /compute/v2.1/servers/78c535d2-a4ae-43ff-bf93-8c35dfb79876" status: 204 len: 0 microversion: 2.20 time: 0.234949 Oct 17 03:18:31.251421 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 405/844] 10.222.0.27 () {60 vars in 1280 bytes} [Mon Oct 17 03:18:31 2022] DELETE /compute/v2.1/servers/78c535d2-a4ae-43ff-bf93-8c35dfb79876 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 17 03:18:31.261667 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-72046c97-b060-4919-9edd-d0f24def7e56 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:18:31.262365 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-72046c97-b060-4919-9edd-d0f24def7e56 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 78c535d2-a4ae-43ff-bf93-8c35dfb79876] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:18:31.269397 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-72046c97-b060-4919-9edd-d0f24def7e56 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:18:31.270647 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-72046c97-b060-4919-9edd-d0f24def7e56 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:18:31.271305 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-72046c97-b060-4919-9edd-d0f24def7e56 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:18:31.272221 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-72046c97-b060-4919-9edd-d0f24def7e56 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:18:31.272858 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-72046c97-b060-4919-9edd-d0f24def7e56 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:18:31.273517 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-72046c97-b060-4919-9edd-d0f24def7e56 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:18:31.488714 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-72046c97-b060-4919-9edd-d0f24def7e56 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:18:31.498037 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-72046c97-b060-4919-9edd-d0f24def7e56 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:18:31.499534 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-72046c97-b060-4919-9edd-d0f24def7e56 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:18:31.500689 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-72046c97-b060-4919-9edd-d0f24def7e56 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "GET /compute/v2.1/servers/78c535d2-a4ae-43ff-bf93-8c35dfb79876" status: 200 len: 1722 microversion: 2.20 time: 0.244980 Oct 17 03:18:31.501422 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 440/845] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 03:18:31 2022] GET /compute/v2.1/servers/78c535d2-a4ae-43ff-bf93-8c35dfb79876 => generated 1722 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:18:32.526324 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-82e9591b-2b56-4016-b7f2-287a117e024f tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:18:32.527063 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-82e9591b-2b56-4016-b7f2-287a117e024f tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 78c535d2-a4ae-43ff-bf93-8c35dfb79876] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:18:32.533506 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-82e9591b-2b56-4016-b7f2-287a117e024f tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:18:32.533991 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-82e9591b-2b56-4016-b7f2-287a117e024f tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:18:32.534436 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-82e9591b-2b56-4016-b7f2-287a117e024f tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:18:32.535160 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-82e9591b-2b56-4016-b7f2-287a117e024f tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:18:32.535617 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-82e9591b-2b56-4016-b7f2-287a117e024f tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:18:32.536391 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-82e9591b-2b56-4016-b7f2-287a117e024f tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:18:32.684895 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-82e9591b-2b56-4016-b7f2-287a117e024f tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:18:32.694974 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-82e9591b-2b56-4016-b7f2-287a117e024f tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:18:32.696906 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-82e9591b-2b56-4016-b7f2-287a117e024f tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:18:32.698375 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-82e9591b-2b56-4016-b7f2-287a117e024f tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "GET /compute/v2.1/servers/78c535d2-a4ae-43ff-bf93-8c35dfb79876" status: 200 len: 1722 microversion: 2.20 time: 0.176317 Oct 17 03:18:32.699174 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 406/846] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 03:18:32 2022] GET /compute/v2.1/servers/78c535d2-a4ae-43ff-bf93-8c35dfb79876 => generated 1722 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:18:33.734697 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-b674b04c-cc8d-49ec-9c7b-f401b3607d65 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:18:33.735488 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-b674b04c-cc8d-49ec-9c7b-f401b3607d65 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 78c535d2-a4ae-43ff-bf93-8c35dfb79876] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:18:33.742783 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-b674b04c-cc8d-49ec-9c7b-f401b3607d65 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:18:33.743479 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-b674b04c-cc8d-49ec-9c7b-f401b3607d65 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:18:33.744101 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-b674b04c-cc8d-49ec-9c7b-f401b3607d65 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:18:33.745926 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-b674b04c-cc8d-49ec-9c7b-f401b3607d65 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:18:33.746569 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-b674b04c-cc8d-49ec-9c7b-f401b3607d65 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:18:33.747189 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-b674b04c-cc8d-49ec-9c7b-f401b3607d65 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:18:33.887674 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-b674b04c-cc8d-49ec-9c7b-f401b3607d65 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:18:33.900390 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-b674b04c-cc8d-49ec-9c7b-f401b3607d65 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:18:33.902723 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-b674b04c-cc8d-49ec-9c7b-f401b3607d65 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e6d36d529146299970874660e92e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f63b28bb4f4654b53a01507b337d52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:18:33.908958 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-b674b04c-cc8d-49ec-9c7b-f401b3607d65 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "GET /compute/v2.1/servers/78c535d2-a4ae-43ff-bf93-8c35dfb79876" status: 200 len: 1655 microversion: 2.20 time: 0.181006 Oct 17 03:18:33.909536 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 441/847] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 03:18:33 2022] GET /compute/v2.1/servers/78c535d2-a4ae-43ff-bf93-8c35dfb79876 => generated 1655 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 03:18:34.157550 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [req-604540c6-a485-4d99-9119-2ea71864be21 req-8dff7a6d-4386-47d7-9a38-5407da6a2889 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78c535d2-a4ae-43ff-bf93-8c35dfb79876", "name": "network-vif-deleted", "tag": "0fcb1d19-78cc-466d-b47b-f0891a46de92"}]} {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:18:34.174325 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [req-604540c6-a485-4d99-9119-2ea71864be21 req-8dff7a6d-4386-47d7-9a38-5407da6a2889 service nova] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:18:34.174902 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [req-604540c6-a485-4d99-9119-2ea71864be21 req-8dff7a6d-4386-47d7-9a38-5407da6a2889 service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:18:34.175348 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [req-604540c6-a485-4d99-9119-2ea71864be21 req-8dff7a6d-4386-47d7-9a38-5407da6a2889 service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:18:34.191585 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.compute.server_external_events [req-604540c6-a485-4d99-9119-2ea71864be21 req-8dff7a6d-4386-47d7-9a38-5407da6a2889 service nova] Creating event network-vif-deleted:0fcb1d19-78cc-466d-b47b-f0891a46de92 for instance 78c535d2-a4ae-43ff-bf93-8c35dfb79876 on hv-cinder-84697 Oct 17 03:18:34.202610 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [req-604540c6-a485-4d99-9119-2ea71864be21 req-8dff7a6d-4386-47d7-9a38-5407da6a2889 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048589 Oct 17 03:18:34.207031 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 407/848] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 03:18:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:18:34.934609 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-957a9191-cbd8-420d-97e7-e621bdb706dc tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:18:34.935861 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-957a9191-cbd8-420d-97e7-e621bdb706dc tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 78c535d2-a4ae-43ff-bf93-8c35dfb79876] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:18:34.944861 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-957a9191-cbd8-420d-97e7-e621bdb706dc tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:18:34.950235 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-957a9191-cbd8-420d-97e7-e621bdb706dc tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:18:34.950754 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-957a9191-cbd8-420d-97e7-e621bdb706dc tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:18:34.951672 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-957a9191-cbd8-420d-97e7-e621bdb706dc tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:18:34.952301 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-957a9191-cbd8-420d-97e7-e621bdb706dc tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:18:34.952759 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-957a9191-cbd8-420d-97e7-e621bdb706dc tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:18:34.981139 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.wsgi [None req-957a9191-cbd8-420d-97e7-e621bdb706dc tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] HTTP exception thrown: Instance 78c535d2-a4ae-43ff-bf93-8c35dfb79876 could not be found. Oct 17 03:18:34.988968 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-957a9191-cbd8-420d-97e7-e621bdb706dc tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Request method failure captured: Oct 17 03:18:34.988968 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: request: GET /compute/v2.1/servers/78c535d2-a4ae-43ff-bf93-8c35dfb79876 HTTP/1.1 Oct 17 03:18:34.988968 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Accept: application/json Oct 17 03:18:34.988968 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Accept-Encoding: identity Oct 17 03:18:34.988968 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Connection: close Oct 17 03:18:34.988968 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Content-Length: 0 Oct 17 03:18:34.988968 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Content-Type: application/json Oct 17 03:18:34.988968 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Host: 10.222.0.27 Oct 17 03:18:34.988968 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Openstack-System-Scope: None Oct 17 03:18:34.988968 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: User-Agent: python-urllib3/1.26.12 Oct 17 03:18:34.988968 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Auth-Token: gAAAAABjTMfzbKpbt0kOvVu86awv7-V-P59rVIKzQXyrGYlIS0TDAu_L9nhz3LW4BwaRLYShAEIVkXljDizTTsY986WBJQpfs_bFugN6hZoUM4zgN1nzkmnJ89mooLiSyLaBYdxbhQH-jJVO_iyWb4c9To6TMVUwiRACKGKE9VaiqOkgtBJd-VI Oct 17 03:18:34.988968 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Domain-Id: None Oct 17 03:18:34.988968 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Domain-Name: None Oct 17 03:18:34.988968 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Identity-Status: Confirmed Oct 17 03:18:34.988968 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Is-Admin-Project: True Oct 17 03:18:34.988968 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Openstack-Nova-Api-Version: 2.20 Oct 17 03:18:34.988968 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Project-Domain-Id: default Oct 17 03:18:34.988968 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Project-Domain-Name: Default Oct 17 03:18:34.988968 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Project-Id: 36f63b28bb4f4654b53a01507b337d52 Oct 17 03:18:34.988968 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-957531208 Oct 17 03:18:34.988968 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Role: member,reader Oct 17 03:18:34.988968 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Roles: member,reader Oct 17 03:18:34.991074 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/36f63b28bb4f4654b53a01507b337d52"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/36f63b28bb4f4654b53a01507b337d52"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/36f63b28bb4f4654b53a01507b337d52"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_36f63b28bb4f4654b53a01507b337d52"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 17 03:18:34.991074 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Tenant: tempest-AttachVolumeShelveTestJSON-957531208 Oct 17 03:18:34.991074 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Tenant-Id: 36f63b28bb4f4654b53a01507b337d52 Oct 17 03:18:34.991074 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-957531208 Oct 17 03:18:34.991074 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-User: tempest-AttachVolumeShelveTestJSON-957531208-project Oct 17 03:18:34.991074 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-User-Domain-Id: default Oct 17 03:18:34.991074 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-User-Domain-Name: Default Oct 17 03:18:34.991074 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-User-Id: 37e6d36d529146299970874660e92e43 Oct 17 03:18:34.991074 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-User-Name: tempest-AttachVolumeShelveTestJSON-957531208-project Oct 17 03:18:34.991074 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: method: > Oct 17 03:18:34.991074 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: exception: Instance 78c535d2-a4ae-43ff-bf93-8c35dfb79876 could not be found. Oct 17 03:18:34.991074 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: action_args: {'id': '78c535d2-a4ae-43ff-bf93-8c35dfb79876'} Oct 17 03:18:34.992140 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 03:18:34.992140 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:18:34.992140 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 03:18:34.992140 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 03:18:34.992140 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 03:18:34.992140 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 03:18:34.992140 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 03:18:34.992140 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 03:18:34.992140 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 03:18:34.992140 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 03:18:34.992140 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 78c535d2-a4ae-43ff-bf93-8c35dfb79876 could not be found. Oct 17 03:18:34.992140 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Oct 17 03:18:34.992140 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:18:34.992140 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Oct 17 03:18:34.992140 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:18:34.992140 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:18:34.992140 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:18:34.992140 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 03:18:34.992140 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 03:18:34.992140 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 03:18:34.994061 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 03:18:34.994061 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 03:18:34.994061 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 03:18:34.994061 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 03:18:34.994061 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 03:18:34.994061 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 03:18:34.994061 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 03:18:34.994061 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 78c535d2-a4ae-43ff-bf93-8c35dfb79876 could not be found. Oct 17 03:18:34.994061 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Oct 17 03:18:34.994061 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:18:34.994061 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Oct 17 03:18:34.994061 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:18:34.994061 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:18:34.994061 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:18:34.994061 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 03:18:34.994061 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 03:18:34.994061 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 78c535d2-a4ae-43ff-bf93-8c35dfb79876 could not be found. Oct 17 03:18:34.994061 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Oct 17 03:18:34.996097 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-957a9191-cbd8-420d-97e7-e621bdb706dc tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Returning 404 to user: Instance 78c535d2-a4ae-43ff-bf93-8c35dfb79876 could not be found. {{(pid=118886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 03:18:34.996097 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-957a9191-cbd8-420d-97e7-e621bdb706dc tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "GET /compute/v2.1/servers/78c535d2-a4ae-43ff-bf93-8c35dfb79876" status: 404 len: 111 microversion: 2.20 time: 0.061228 Oct 17 03:18:34.996097 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 442/849] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 03:18:34 2022] GET /compute/v2.1/servers/78c535d2-a4ae-43ff-bf93-8c35dfb79876 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 17 03:18:35.004487 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-8c4bba32-d7e3-4305-94ed-2dc20ee201f9 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '.version_select at 0x7fc7016f1e50>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:18:35.013325 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG dbcounter [-] [118887] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=2,nova_api:DELETE=2 {{(pid=118887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:18:35.044478 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-8c4bba32-d7e3-4305-94ed-2dc20ee201f9 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-988862253" status: 204 len: 0 microversion: 2.20 time: 0.044053 Oct 17 03:18:35.045941 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 408/850] 10.222.0.27 () {60 vars in 1259 bytes} [Mon Oct 17 03:18:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-988862253 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 17 03:18:37.524049 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-1847d86f-f988-4991-9526-c1a58c94363f tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:18:37.526368 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-1847d86f-f988-4991-9526-c1a58c94363f tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 78c535d2-a4ae-43ff-bf93-8c35dfb79876] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:18:37.534669 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-1847d86f-f988-4991-9526-c1a58c94363f tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:18:37.535272 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-1847d86f-f988-4991-9526-c1a58c94363f tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:18:37.535843 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-1847d86f-f988-4991-9526-c1a58c94363f tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:18:37.536805 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-1847d86f-f988-4991-9526-c1a58c94363f tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:18:37.537485 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-1847d86f-f988-4991-9526-c1a58c94363f tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:18:37.538065 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-1847d86f-f988-4991-9526-c1a58c94363f tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:18:37.554602 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.wsgi [None req-1847d86f-f988-4991-9526-c1a58c94363f tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] HTTP exception thrown: Instance 78c535d2-a4ae-43ff-bf93-8c35dfb79876 could not be found. Oct 17 03:18:37.558599 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-1847d86f-f988-4991-9526-c1a58c94363f tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Request method failure captured: Oct 17 03:18:37.558599 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: request: DELETE /compute/v2.1/servers/78c535d2-a4ae-43ff-bf93-8c35dfb79876 HTTP/1.1 Oct 17 03:18:37.558599 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Accept: application/json Oct 17 03:18:37.558599 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Accept-Encoding: identity Oct 17 03:18:37.558599 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Connection: close Oct 17 03:18:37.558599 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Content-Length: 0 Oct 17 03:18:37.558599 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Content-Type: application/json Oct 17 03:18:37.558599 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Host: 10.222.0.27 Oct 17 03:18:37.558599 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Openstack-System-Scope: None Oct 17 03:18:37.558599 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: User-Agent: python-urllib3/1.26.12 Oct 17 03:18:37.558599 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Auth-Token: gAAAAABjTMfzbKpbt0kOvVu86awv7-V-P59rVIKzQXyrGYlIS0TDAu_L9nhz3LW4BwaRLYShAEIVkXljDizTTsY986WBJQpfs_bFugN6hZoUM4zgN1nzkmnJ89mooLiSyLaBYdxbhQH-jJVO_iyWb4c9To6TMVUwiRACKGKE9VaiqOkgtBJd-VI Oct 17 03:18:37.558599 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Domain-Id: None Oct 17 03:18:37.558599 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Domain-Name: None Oct 17 03:18:37.558599 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Identity-Status: Confirmed Oct 17 03:18:37.558599 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Is-Admin-Project: True Oct 17 03:18:37.558599 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Openstack-Nova-Api-Version: 2.20 Oct 17 03:18:37.558599 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Project-Domain-Id: default Oct 17 03:18:37.558599 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Project-Domain-Name: Default Oct 17 03:18:37.558599 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Project-Id: 36f63b28bb4f4654b53a01507b337d52 Oct 17 03:18:37.558599 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-957531208 Oct 17 03:18:37.558599 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Role: member,reader Oct 17 03:18:37.558599 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Roles: member,reader Oct 17 03:18:37.560271 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/36f63b28bb4f4654b53a01507b337d52"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/36f63b28bb4f4654b53a01507b337d52"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/36f63b28bb4f4654b53a01507b337d52"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_36f63b28bb4f4654b53a01507b337d52"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 17 03:18:37.560271 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Tenant: tempest-AttachVolumeShelveTestJSON-957531208 Oct 17 03:18:37.560271 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Tenant-Id: 36f63b28bb4f4654b53a01507b337d52 Oct 17 03:18:37.560271 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-957531208 Oct 17 03:18:37.560271 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-User: tempest-AttachVolumeShelveTestJSON-957531208-project Oct 17 03:18:37.560271 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-User-Domain-Id: default Oct 17 03:18:37.560271 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-User-Domain-Name: Default Oct 17 03:18:37.560271 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-User-Id: 37e6d36d529146299970874660e92e43 Oct 17 03:18:37.560271 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-User-Name: tempest-AttachVolumeShelveTestJSON-957531208-project Oct 17 03:18:37.560271 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: method: > Oct 17 03:18:37.560271 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: exception: Instance 78c535d2-a4ae-43ff-bf93-8c35dfb79876 could not be found. Oct 17 03:18:37.560271 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: action_args: {'id': '78c535d2-a4ae-43ff-bf93-8c35dfb79876'} Oct 17 03:18:37.561316 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 03:18:37.561316 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:18:37.561316 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 03:18:37.561316 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 03:18:37.561316 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 03:18:37.561316 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 03:18:37.561316 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 03:18:37.561316 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 03:18:37.561316 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 03:18:37.561316 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 03:18:37.561316 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 78c535d2-a4ae-43ff-bf93-8c35dfb79876 could not be found. Oct 17 03:18:37.561316 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Oct 17 03:18:37.561316 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:18:37.561316 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Oct 17 03:18:37.561316 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:18:37.561316 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:18:37.561316 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:18:37.561316 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 03:18:37.561316 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 03:18:37.561316 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 03:18:37.562791 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 03:18:37.562791 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 03:18:37.562791 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 03:18:37.562791 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 03:18:37.562791 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 03:18:37.562791 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 03:18:37.562791 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 03:18:37.562791 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 03:18:37.562791 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 03:18:37.562791 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 78c535d2-a4ae-43ff-bf93-8c35dfb79876 could not be found. Oct 17 03:18:37.562791 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Oct 17 03:18:37.562791 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:18:37.562791 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Oct 17 03:18:37.562791 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:18:37.562791 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:18:37.562791 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:18:37.562791 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 03:18:37.562791 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 03:18:37.562791 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 78c535d2-a4ae-43ff-bf93-8c35dfb79876 could not be found. Oct 17 03:18:37.562791 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Oct 17 03:18:37.565706 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-1847d86f-f988-4991-9526-c1a58c94363f tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Returning 404 to user: Instance 78c535d2-a4ae-43ff-bf93-8c35dfb79876 could not be found. {{(pid=118886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 03:18:37.567189 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-1847d86f-f988-4991-9526-c1a58c94363f tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "DELETE /compute/v2.1/servers/78c535d2-a4ae-43ff-bf93-8c35dfb79876" status: 404 len: 111 microversion: 2.20 time: 0.048027 Oct 17 03:18:37.571089 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 443/851] 10.222.0.27 () {60 vars in 1280 bytes} [Mon Oct 17 03:18:37 2022] DELETE /compute/v2.1/servers/78c535d2-a4ae-43ff-bf93-8c35dfb79876 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 17 03:18:37.577852 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-bd79a9f5-96fb-4f0a-839c-a87fd3f881c4 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:18:37.578604 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-bd79a9f5-96fb-4f0a-839c-a87fd3f881c4 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 78c535d2-a4ae-43ff-bf93-8c35dfb79876] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:18:37.608406 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-bd79a9f5-96fb-4f0a-839c-a87fd3f881c4 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:18:37.608925 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-bd79a9f5-96fb-4f0a-839c-a87fd3f881c4 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:18:37.609369 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-bd79a9f5-96fb-4f0a-839c-a87fd3f881c4 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:18:37.610734 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-bd79a9f5-96fb-4f0a-839c-a87fd3f881c4 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:18:37.611233 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-bd79a9f5-96fb-4f0a-839c-a87fd3f881c4 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:18:37.611673 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-bd79a9f5-96fb-4f0a-839c-a87fd3f881c4 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:18:37.641105 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.wsgi [None req-bd79a9f5-96fb-4f0a-839c-a87fd3f881c4 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] HTTP exception thrown: Instance 78c535d2-a4ae-43ff-bf93-8c35dfb79876 could not be found. Oct 17 03:18:37.642816 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-bd79a9f5-96fb-4f0a-839c-a87fd3f881c4 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Request method failure captured: Oct 17 03:18:37.642816 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: request: GET /compute/v2.1/servers/78c535d2-a4ae-43ff-bf93-8c35dfb79876 HTTP/1.1 Oct 17 03:18:37.642816 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Accept: application/json Oct 17 03:18:37.642816 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Accept-Encoding: identity Oct 17 03:18:37.642816 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Connection: close Oct 17 03:18:37.642816 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Content-Length: 0 Oct 17 03:18:37.642816 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Content-Type: application/json Oct 17 03:18:37.642816 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Host: 10.222.0.27 Oct 17 03:18:37.642816 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Openstack-System-Scope: None Oct 17 03:18:37.642816 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: User-Agent: python-urllib3/1.26.12 Oct 17 03:18:37.642816 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Auth-Token: gAAAAABjTMfzbKpbt0kOvVu86awv7-V-P59rVIKzQXyrGYlIS0TDAu_L9nhz3LW4BwaRLYShAEIVkXljDizTTsY986WBJQpfs_bFugN6hZoUM4zgN1nzkmnJ89mooLiSyLaBYdxbhQH-jJVO_iyWb4c9To6TMVUwiRACKGKE9VaiqOkgtBJd-VI Oct 17 03:18:37.642816 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Domain-Id: None Oct 17 03:18:37.642816 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Domain-Name: None Oct 17 03:18:37.642816 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Identity-Status: Confirmed Oct 17 03:18:37.642816 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Is-Admin-Project: True Oct 17 03:18:37.642816 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Openstack-Nova-Api-Version: 2.20 Oct 17 03:18:37.642816 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Project-Domain-Id: default Oct 17 03:18:37.642816 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Project-Domain-Name: Default Oct 17 03:18:37.642816 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Project-Id: 36f63b28bb4f4654b53a01507b337d52 Oct 17 03:18:37.642816 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-957531208 Oct 17 03:18:37.642816 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Role: member,reader Oct 17 03:18:37.642816 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Roles: member,reader Oct 17 03:18:37.644448 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/36f63b28bb4f4654b53a01507b337d52"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/36f63b28bb4f4654b53a01507b337d52"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/36f63b28bb4f4654b53a01507b337d52"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_36f63b28bb4f4654b53a01507b337d52"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 17 03:18:37.644448 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Tenant: tempest-AttachVolumeShelveTestJSON-957531208 Oct 17 03:18:37.644448 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Tenant-Id: 36f63b28bb4f4654b53a01507b337d52 Oct 17 03:18:37.644448 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-957531208 Oct 17 03:18:37.644448 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-User: tempest-AttachVolumeShelveTestJSON-957531208-project Oct 17 03:18:37.644448 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-User-Domain-Id: default Oct 17 03:18:37.644448 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-User-Domain-Name: Default Oct 17 03:18:37.644448 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-User-Id: 37e6d36d529146299970874660e92e43 Oct 17 03:18:37.644448 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-User-Name: tempest-AttachVolumeShelveTestJSON-957531208-project Oct 17 03:18:37.644448 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: method: > Oct 17 03:18:37.644448 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: exception: Instance 78c535d2-a4ae-43ff-bf93-8c35dfb79876 could not be found. Oct 17 03:18:37.644448 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: action_args: {'id': '78c535d2-a4ae-43ff-bf93-8c35dfb79876'} Oct 17 03:18:37.645319 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 03:18:37.645319 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:18:37.645319 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 03:18:37.645319 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 03:18:37.645319 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 03:18:37.645319 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 03:18:37.645319 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 03:18:37.645319 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 03:18:37.645319 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 03:18:37.645319 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 03:18:37.645319 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 78c535d2-a4ae-43ff-bf93-8c35dfb79876 could not be found. Oct 17 03:18:37.645319 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Oct 17 03:18:37.645319 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:18:37.645319 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Oct 17 03:18:37.645319 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:18:37.645319 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:18:37.645319 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:18:37.645319 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 03:18:37.645319 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 03:18:37.645319 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 03:18:37.646798 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 03:18:37.646798 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 03:18:37.646798 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 03:18:37.646798 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 03:18:37.646798 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 03:18:37.646798 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 03:18:37.646798 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 03:18:37.646798 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 78c535d2-a4ae-43ff-bf93-8c35dfb79876 could not be found. Oct 17 03:18:37.646798 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Oct 17 03:18:37.646798 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:18:37.646798 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Oct 17 03:18:37.646798 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:18:37.646798 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:18:37.646798 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:18:37.646798 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 03:18:37.646798 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 03:18:37.646798 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 78c535d2-a4ae-43ff-bf93-8c35dfb79876 could not be found. Oct 17 03:18:37.646798 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Oct 17 03:18:37.648142 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-bd79a9f5-96fb-4f0a-839c-a87fd3f881c4 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Returning 404 to user: Instance 78c535d2-a4ae-43ff-bf93-8c35dfb79876 could not be found. {{(pid=118887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 03:18:37.648142 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-bd79a9f5-96fb-4f0a-839c-a87fd3f881c4 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "GET /compute/v2.1/servers/78c535d2-a4ae-43ff-bf93-8c35dfb79876" status: 404 len: 111 microversion: 2.20 time: 0.071272 Oct 17 03:18:37.669136 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 409/852] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 03:18:37 2022] GET /compute/v2.1/servers/78c535d2-a4ae-43ff-bf93-8c35dfb79876 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 17 03:18:38.005557 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-6a4cf35a-53fb-4893-a090-9e813cce61d7 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:18:38.016386 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-6a4cf35a-53fb-4893-a090-9e813cce61d7 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 603ee2bf-bedf-4688-ac0a-77a2a50f33d7] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:18:38.031133 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-6a4cf35a-53fb-4893-a090-9e813cce61d7 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:18:38.032062 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-6a4cf35a-53fb-4893-a090-9e813cce61d7 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:18:38.034057 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-6a4cf35a-53fb-4893-a090-9e813cce61d7 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:18:38.037522 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-6a4cf35a-53fb-4893-a090-9e813cce61d7 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:18:38.038132 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-6a4cf35a-53fb-4893-a090-9e813cce61d7 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:18:38.038795 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-6a4cf35a-53fb-4893-a090-9e813cce61d7 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:18:38.081803 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.wsgi [None req-6a4cf35a-53fb-4893-a090-9e813cce61d7 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] HTTP exception thrown: Instance 603ee2bf-bedf-4688-ac0a-77a2a50f33d7 could not be found. Oct 17 03:18:38.083415 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-6a4cf35a-53fb-4893-a090-9e813cce61d7 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Request method failure captured: Oct 17 03:18:38.083415 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: request: DELETE /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7 HTTP/1.1 Oct 17 03:18:38.083415 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Accept: application/json Oct 17 03:18:38.083415 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Accept-Encoding: identity Oct 17 03:18:38.083415 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Connection: close Oct 17 03:18:38.083415 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Content-Length: 0 Oct 17 03:18:38.083415 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Content-Type: application/json Oct 17 03:18:38.083415 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Host: 10.222.0.27 Oct 17 03:18:38.083415 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Openstack-System-Scope: None Oct 17 03:18:38.083415 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: User-Agent: python-urllib3/1.26.12 Oct 17 03:18:38.083415 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Auth-Token: gAAAAABjTMfzbKpbt0kOvVu86awv7-V-P59rVIKzQXyrGYlIS0TDAu_L9nhz3LW4BwaRLYShAEIVkXljDizTTsY986WBJQpfs_bFugN6hZoUM4zgN1nzkmnJ89mooLiSyLaBYdxbhQH-jJVO_iyWb4c9To6TMVUwiRACKGKE9VaiqOkgtBJd-VI Oct 17 03:18:38.083415 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Domain-Id: None Oct 17 03:18:38.083415 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Domain-Name: None Oct 17 03:18:38.083415 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Identity-Status: Confirmed Oct 17 03:18:38.083415 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Is-Admin-Project: True Oct 17 03:18:38.083415 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Openstack-Nova-Api-Version: 2.20 Oct 17 03:18:38.083415 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Project-Domain-Id: default Oct 17 03:18:38.083415 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Project-Domain-Name: Default Oct 17 03:18:38.083415 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Project-Id: 36f63b28bb4f4654b53a01507b337d52 Oct 17 03:18:38.083415 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-957531208 Oct 17 03:18:38.083415 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Role: member,reader Oct 17 03:18:38.083415 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Roles: member,reader Oct 17 03:18:38.085052 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/36f63b28bb4f4654b53a01507b337d52"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/36f63b28bb4f4654b53a01507b337d52"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/36f63b28bb4f4654b53a01507b337d52"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_36f63b28bb4f4654b53a01507b337d52"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 17 03:18:38.085052 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Tenant: tempest-AttachVolumeShelveTestJSON-957531208 Oct 17 03:18:38.085052 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Tenant-Id: 36f63b28bb4f4654b53a01507b337d52 Oct 17 03:18:38.085052 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-957531208 Oct 17 03:18:38.085052 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-User: tempest-AttachVolumeShelveTestJSON-957531208-project Oct 17 03:18:38.085052 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-User-Domain-Id: default Oct 17 03:18:38.085052 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-User-Domain-Name: Default Oct 17 03:18:38.085052 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-User-Id: 37e6d36d529146299970874660e92e43 Oct 17 03:18:38.085052 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-User-Name: tempest-AttachVolumeShelveTestJSON-957531208-project Oct 17 03:18:38.085052 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: method: > Oct 17 03:18:38.085052 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: exception: Instance 603ee2bf-bedf-4688-ac0a-77a2a50f33d7 could not be found. Oct 17 03:18:38.085052 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: action_args: {'id': '603ee2bf-bedf-4688-ac0a-77a2a50f33d7'} Oct 17 03:18:38.085926 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 03:18:38.085926 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:18:38.085926 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 03:18:38.085926 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 03:18:38.085926 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 03:18:38.085926 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 03:18:38.085926 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 03:18:38.085926 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 03:18:38.085926 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 03:18:38.085926 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 03:18:38.085926 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 603ee2bf-bedf-4688-ac0a-77a2a50f33d7 could not be found. Oct 17 03:18:38.085926 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Oct 17 03:18:38.085926 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:18:38.085926 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Oct 17 03:18:38.085926 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:18:38.085926 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:18:38.085926 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:18:38.085926 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 03:18:38.085926 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 03:18:38.085926 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 03:18:38.090670 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 03:18:38.090670 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 03:18:38.090670 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 03:18:38.090670 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 03:18:38.090670 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 03:18:38.090670 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 03:18:38.090670 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 03:18:38.090670 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 03:18:38.090670 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 03:18:38.090670 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 603ee2bf-bedf-4688-ac0a-77a2a50f33d7 could not be found. Oct 17 03:18:38.090670 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Oct 17 03:18:38.090670 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:18:38.090670 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Oct 17 03:18:38.090670 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:18:38.090670 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:18:38.090670 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:18:38.090670 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 03:18:38.090670 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 03:18:38.090670 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 603ee2bf-bedf-4688-ac0a-77a2a50f33d7 could not be found. Oct 17 03:18:38.090670 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Oct 17 03:18:38.092175 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-6a4cf35a-53fb-4893-a090-9e813cce61d7 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Returning 404 to user: Instance 603ee2bf-bedf-4688-ac0a-77a2a50f33d7 could not be found. {{(pid=118886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 03:18:38.092175 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-6a4cf35a-53fb-4893-a090-9e813cce61d7 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "DELETE /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7" status: 404 len: 111 microversion: 2.20 time: 0.085463 Oct 17 03:18:38.092175 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 444/853] 10.222.0.27 () {60 vars in 1280 bytes} [Mon Oct 17 03:18:37 2022] DELETE /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 17 03:18:38.099216 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-b9c9d9e3-8864-4dd4-841c-6f198fde2b17 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:18:38.100066 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-b9c9d9e3-8864-4dd4-841c-6f198fde2b17 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] [instance: 603ee2bf-bedf-4688-ac0a-77a2a50f33d7] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:18:38.111730 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-b9c9d9e3-8864-4dd4-841c-6f198fde2b17 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:18:38.113253 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-b9c9d9e3-8864-4dd4-841c-6f198fde2b17 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:18:38.114301 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-b9c9d9e3-8864-4dd4-841c-6f198fde2b17 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:18:38.119284 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-b9c9d9e3-8864-4dd4-841c-6f198fde2b17 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:18:38.120462 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-b9c9d9e3-8864-4dd4-841c-6f198fde2b17 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:18:38.124345 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-b9c9d9e3-8864-4dd4-841c-6f198fde2b17 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:18:38.142598 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.wsgi [None req-b9c9d9e3-8864-4dd4-841c-6f198fde2b17 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] HTTP exception thrown: Instance 603ee2bf-bedf-4688-ac0a-77a2a50f33d7 could not be found. Oct 17 03:18:38.144175 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-b9c9d9e3-8864-4dd4-841c-6f198fde2b17 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Request method failure captured: Oct 17 03:18:38.144175 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: request: GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7 HTTP/1.1 Oct 17 03:18:38.144175 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Accept: application/json Oct 17 03:18:38.144175 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Accept-Encoding: identity Oct 17 03:18:38.144175 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Connection: close Oct 17 03:18:38.144175 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Content-Length: 0 Oct 17 03:18:38.144175 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Content-Type: application/json Oct 17 03:18:38.144175 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Host: 10.222.0.27 Oct 17 03:18:38.144175 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Openstack-System-Scope: None Oct 17 03:18:38.144175 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: User-Agent: python-urllib3/1.26.12 Oct 17 03:18:38.144175 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Auth-Token: gAAAAABjTMfzbKpbt0kOvVu86awv7-V-P59rVIKzQXyrGYlIS0TDAu_L9nhz3LW4BwaRLYShAEIVkXljDizTTsY986WBJQpfs_bFugN6hZoUM4zgN1nzkmnJ89mooLiSyLaBYdxbhQH-jJVO_iyWb4c9To6TMVUwiRACKGKE9VaiqOkgtBJd-VI Oct 17 03:18:38.144175 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Domain-Id: None Oct 17 03:18:38.144175 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Domain-Name: None Oct 17 03:18:38.144175 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Identity-Status: Confirmed Oct 17 03:18:38.144175 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Is-Admin-Project: True Oct 17 03:18:38.144175 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Openstack-Nova-Api-Version: 2.20 Oct 17 03:18:38.144175 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Project-Domain-Id: default Oct 17 03:18:38.144175 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Project-Domain-Name: Default Oct 17 03:18:38.144175 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Project-Id: 36f63b28bb4f4654b53a01507b337d52 Oct 17 03:18:38.144175 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-957531208 Oct 17 03:18:38.144175 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Role: member,reader Oct 17 03:18:38.144175 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Roles: member,reader Oct 17 03:18:38.145847 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/36f63b28bb4f4654b53a01507b337d52"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/36f63b28bb4f4654b53a01507b337d52"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/36f63b28bb4f4654b53a01507b337d52"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_36f63b28bb4f4654b53a01507b337d52"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 17 03:18:38.145847 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Tenant: tempest-AttachVolumeShelveTestJSON-957531208 Oct 17 03:18:38.145847 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Tenant-Id: 36f63b28bb4f4654b53a01507b337d52 Oct 17 03:18:38.145847 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-957531208 Oct 17 03:18:38.145847 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-User: tempest-AttachVolumeShelveTestJSON-957531208-project Oct 17 03:18:38.145847 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-User-Domain-Id: default Oct 17 03:18:38.145847 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-User-Domain-Name: Default Oct 17 03:18:38.145847 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-User-Id: 37e6d36d529146299970874660e92e43 Oct 17 03:18:38.145847 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-User-Name: tempest-AttachVolumeShelveTestJSON-957531208-project Oct 17 03:18:38.145847 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: method: > Oct 17 03:18:38.145847 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: exception: Instance 603ee2bf-bedf-4688-ac0a-77a2a50f33d7 could not be found. Oct 17 03:18:38.145847 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: action_args: {'id': '603ee2bf-bedf-4688-ac0a-77a2a50f33d7'} Oct 17 03:18:38.146754 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 03:18:38.146754 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:18:38.146754 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 03:18:38.146754 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 03:18:38.146754 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 03:18:38.146754 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 03:18:38.146754 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 03:18:38.146754 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 03:18:38.146754 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 03:18:38.146754 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 03:18:38.146754 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 603ee2bf-bedf-4688-ac0a-77a2a50f33d7 could not be found. Oct 17 03:18:38.146754 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Oct 17 03:18:38.146754 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:18:38.146754 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Oct 17 03:18:38.146754 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:18:38.146754 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:18:38.146754 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:18:38.146754 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 03:18:38.146754 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 03:18:38.146754 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 03:18:38.148227 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 03:18:38.148227 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 03:18:38.148227 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 03:18:38.148227 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 03:18:38.148227 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 03:18:38.148227 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 03:18:38.148227 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 03:18:38.148227 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 603ee2bf-bedf-4688-ac0a-77a2a50f33d7 could not be found. Oct 17 03:18:38.148227 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Oct 17 03:18:38.148227 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:18:38.148227 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Oct 17 03:18:38.148227 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:18:38.148227 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:18:38.148227 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:18:38.148227 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 03:18:38.148227 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 03:18:38.148227 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 603ee2bf-bedf-4688-ac0a-77a2a50f33d7 could not be found. Oct 17 03:18:38.148227 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Oct 17 03:18:38.149572 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-b9c9d9e3-8864-4dd4-841c-6f198fde2b17 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] Returning 404 to user: Instance 603ee2bf-bedf-4688-ac0a-77a2a50f33d7 could not be found. {{(pid=118887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 03:18:38.149572 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-b9c9d9e3-8864-4dd4-841c-6f198fde2b17 tempest-AttachVolumeShelveTestJSON-957531208 tempest-AttachVolumeShelveTestJSON-957531208-project] 10.222.0.27 "GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7" status: 404 len: 111 microversion: 2.20 time: 0.053164 Oct 17 03:18:38.149572 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 410/854] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 17 03:18:38 2022] GET /compute/v2.1/servers/603ee2bf-bedf-4688-ac0a-77a2a50f33d7 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 17 03:18:47.742278 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-914129ca-cdee-49dd-8b46-f375369a3547 tempest-VolumesTestJSON-1323148709 tempest-VolumesTestJSON-1323148709-project] Calling method '.version_select at 0x7fc7016bf700>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:18:47.822574 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-914129ca-cdee-49dd-8b46-f375369a3547 tempest-VolumesTestJSON-1323148709 tempest-VolumesTestJSON-1323148709-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/34dd4077-0937-4ff0-bd97-032e6801f5ea" status: 200 len: 351 microversion: 2.1 time: 0.087057 Oct 17 03:18:47.823856 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 445/855] 10.222.0.27 () {58 vars in 1245 bytes} [Mon Oct 17 03:18:47 2022] GET /compute/v2.1/os-volumes/34dd4077-0937-4ff0-bd97-032e6801f5ea => generated 351 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:18:49.336441 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-16db029e-6bdd-4331-88c1-cad73d52db67 tempest-VolumesTestJSON-1323148709 tempest-VolumesTestJSON-1323148709-project] Calling method '.version_select at 0x7fc7016a4790>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:18:49.363312 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG dbcounter [-] [118887] Writing DB stats nova_api:SELECT=6,nova_api:DELETE=1 {{(pid=118887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:18:49.365422 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG dbcounter [-] [118887] Writing DB stats nova_cell1:SELECT=19,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:18:49.463075 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-16db029e-6bdd-4331-88c1-cad73d52db67 tempest-VolumesTestJSON-1323148709 tempest-VolumesTestJSON-1323148709-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/db846849-6bf5-47e3-b7dd-a8af02b28c47" status: 200 len: 351 microversion: 2.1 time: 0.146633 Oct 17 03:18:49.464954 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 411/856] 10.222.0.27 () {58 vars in 1245 bytes} [Mon Oct 17 03:18:49 2022] GET /compute/v2.1/os-volumes/db846849-6bf5-47e3-b7dd-a8af02b28c47 => generated 351 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:18:51.071777 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-91feb957-560c-4a78-a1fb-67229d869370 tempest-VolumesTestJSON-1323148709 tempest-VolumesTestJSON-1323148709-project] Calling method '.version_select at 0x7fc70341a430>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:18:51.083155 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG dbcounter [-] [118886] Writing DB stats nova_api:SELECT=11 {{(pid=118886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:18:51.084545 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG dbcounter [-] [118886] Writing DB stats nova_cell1:SELECT=52 {{(pid=118886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:18:51.180658 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-91feb957-560c-4a78-a1fb-67229d869370 tempest-VolumesTestJSON-1323148709 tempest-VolumesTestJSON-1323148709-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/e23ef0f4-c233-4f6a-8aae-3ce657f4ce1e" status: 200 len: 350 microversion: 2.1 time: 0.114421 Oct 17 03:18:51.181960 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 446/857] 10.222.0.27 () {58 vars in 1245 bytes} [Mon Oct 17 03:18:51 2022] GET /compute/v2.1/os-volumes/e23ef0f4-c233-4f6a-8aae-3ce657f4ce1e => generated 350 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:18:51.195984 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-791cf429-493b-4d68-a68a-d7d1a0ff671a tempest-VolumesTestJSON-1323148709 tempest-VolumesTestJSON-1323148709-project] Calling method '.version_select at 0x7fc701647f70>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:18:51.301921 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-791cf429-493b-4d68-a68a-d7d1a0ff671a tempest-VolumesTestJSON-1323148709 tempest-VolumesTestJSON-1323148709-project] 10.222.0.27 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.109719 Oct 17 03:18:51.303111 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 412/858] 10.222.0.27 () {58 vars in 1134 bytes} [Mon Oct 17 03:18:51 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:18:51.318032 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-fefba33c-d90e-4cf0-b533-887a7209f2de tempest-VolumesTestJSON-1323148709 tempest-VolumesTestJSON-1323148709-project] Calling method '.version_select at 0x7fc70165ef70>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:18:51.446264 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-fefba33c-d90e-4cf0-b533-887a7209f2de tempest-VolumesTestJSON-1323148709 tempest-VolumesTestJSON-1323148709-project] 10.222.0.27 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.131900 Oct 17 03:18:51.446890 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 447/859] 10.222.0.27 () {58 vars in 1149 bytes} [Mon Oct 17 03:18:51 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:18:51.462814 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-12536a3c-5756-49df-a396-76e5131d368c tempest-VolumesTestJSON-1323148709 tempest-VolumesTestJSON-1323148709-project] Calling method '.version_select at 0x7fc7016a41f0>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:18:51.565513 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-12536a3c-5756-49df-a396-76e5131d368c tempest-VolumesTestJSON-1323148709 tempest-VolumesTestJSON-1323148709-project] 10.222.0.27 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.106931 Oct 17 03:18:51.576411 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 413/860] 10.222.0.27 () {58 vars in 1134 bytes} [Mon Oct 17 03:18:51 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:18:51.581029 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-3ee3590c-e29f-4ec0-9603-76fbe53b2053 tempest-VolumesTestJSON-1323148709 tempest-VolumesTestJSON-1323148709-project] Calling method '.version_select at 0x7fc7016bf310>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:18:51.690166 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-3ee3590c-e29f-4ec0-9603-76fbe53b2053 tempest-VolumesTestJSON-1323148709 tempest-VolumesTestJSON-1323148709-project] 10.222.0.27 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.113282 Oct 17 03:18:51.691308 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 448/861] 10.222.0.27 () {58 vars in 1167 bytes} [Mon Oct 17 03:18:51 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:18:51.714261 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-5ec43cad-4adb-4635-a154-36b6a0c7825e tempest-VolumesTestJSON-1323148709 tempest-VolumesTestJSON-1323148709-project] Calling method '.version_select at 0x7fc7016620d0>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:18:51.859006 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-5ec43cad-4adb-4635-a154-36b6a0c7825e tempest-VolumesTestJSON-1323148709 tempest-VolumesTestJSON-1323148709-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.155481 Oct 17 03:18:51.878683 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 414/862] 10.222.0.27 () {58 vars in 1170 bytes} [Mon Oct 17 03:18:51 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:18:51.878948 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-f4ee78dc-0e1c-4c69-950a-ae294d548756 tempest-VolumesTestJSON-1323148709 tempest-VolumesTestJSON-1323148709-project] Calling method '.version_select at 0x7fc7016df550>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:18:52.036156 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-f4ee78dc-0e1c-4c69-950a-ae294d548756 tempest-VolumesTestJSON-1323148709 tempest-VolumesTestJSON-1323148709-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.161688 Oct 17 03:18:52.043802 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 449/863] 10.222.0.27 () {58 vars in 1155 bytes} [Mon Oct 17 03:18:51 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:18:52.051224 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-33772e8d-ab6d-42f6-acdb-857b879a11d9 tempest-VolumesTestJSON-1323148709 tempest-VolumesTestJSON-1323148709-project] Calling method '.version_select at 0x7fc70168c4c0>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:18:52.212089 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-33772e8d-ab6d-42f6-acdb-857b879a11d9 tempest-VolumesTestJSON-1323148709 tempest-VolumesTestJSON-1323148709-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.164593 Oct 17 03:18:52.215251 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 415/864] 10.222.0.27 () {58 vars in 1188 bytes} [Mon Oct 17 03:18:52 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:18:52.229850 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-e642fe82-9331-47d4-90d8-c00a84f0214b tempest-VolumesTestJSON-1323148709 tempest-VolumesTestJSON-1323148709-project] Calling method '.version_select at 0x7fc701694dc0>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:18:52.327544 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-e642fe82-9331-47d4-90d8-c00a84f0214b tempest-VolumesTestJSON-1323148709 tempest-VolumesTestJSON-1323148709-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.102430 Oct 17 03:18:52.343063 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 450/865] 10.222.0.27 () {58 vars in 1155 bytes} [Mon Oct 17 03:18:52 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:18:56.878353 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-d68b3274-6e1f-4521-914c-116cc7a6b0bd tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Action: 'create', calling method: .version_select at 0x7fc7016f1b80>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1388360878", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJHz8CEhSc0gZktBZ4dCSDx5VM4mfDyMdB8hBDKWRNbj74nQcx4LX0fPtnb66BEIipN7vZER8SpgRg/RdLHHdUhd0aMl9cp0Ogb0ZGtgAmVHuTnzK5wXibUUfKhpAjazbQ=="}} {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:18:56.895930 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.quota [None req-d68b3274-6e1f-4521-914c-116cc7a6b0bd tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Getting quotas for project dc518d9b31644a8d8b21cf9c645b1373. Resources: {'key_pairs'} {{(pid=118887) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 03:18:56.899708 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.quota [None req-d68b3274-6e1f-4521-914c-116cc7a6b0bd tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Getting quotas for user 82da4b8f8bdb4dbab655ff510bfa328f and project dc518d9b31644a8d8b21cf9c645b1373. Resources: {'key_pairs'} {{(pid=118887) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 03:18:56.922543 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-d68b3274-6e1f-4521-914c-116cc7a6b0bd tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.048514 Oct 17 03:18:56.923178 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 416/866] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 17 03:18:56 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:18:57.024941 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-d3de05eb-0e91-4b83-b58d-0d95a54e4777 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-760118726", "imageRef": "df895798-2211-4403-8fb7-0333acd47a3e", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1388360878", "networks": [{"uuid": "fff0603d-1cdb-4220-8dfd-3ace1c5fcead"}]}} {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:18:57.086159 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.network.neutron [None req-d3de05eb-0e91-4b83-b58d-0d95a54e4777 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] validate_networks() for [('fff0603d-1cdb-4220-8dfd-3ace1c5fcead', None, None, None, None, None)] {{(pid=118886) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 03:18:57.665540 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.virt.hardware [None req-d3de05eb-0e91-4b83-b58d-0d95a54e4777 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Flavor limits 0:0:0 {{(pid=118886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 03:18:57.666028 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.virt.hardware [None req-d3de05eb-0e91-4b83-b58d-0d95a54e4777 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Image limits 0:0:0 {{(pid=118886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 03:18:57.667155 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.virt.hardware [None req-d3de05eb-0e91-4b83-b58d-0d95a54e4777 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Flavor pref 0:0:0 {{(pid=118886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 03:18:57.667894 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.virt.hardware [None req-d3de05eb-0e91-4b83-b58d-0d95a54e4777 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Image pref 0:0:0 {{(pid=118886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 03:18:57.668619 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.virt.hardware [None req-d3de05eb-0e91-4b83-b58d-0d95a54e4777 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 03:18:57.677638 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-d3de05eb-0e91-4b83-b58d-0d95a54e4777 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:18:57.678404 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-d3de05eb-0e91-4b83-b58d-0d95a54e4777 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:18:57.678829 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-d3de05eb-0e91-4b83-b58d-0d95a54e4777 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:18:57.679839 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-d3de05eb-0e91-4b83-b58d-0d95a54e4777 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:18:57.680298 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-d3de05eb-0e91-4b83-b58d-0d95a54e4777 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:18:57.680720 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-d3de05eb-0e91-4b83-b58d-0d95a54e4777 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:18:57.698590 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.quota [None req-d3de05eb-0e91-4b83-b58d-0d95a54e4777 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Getting quotas for project dc518d9b31644a8d8b21cf9c645b1373. Resources: {'instances', 'cores', 'ram'} {{(pid=118886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 03:18:57.702976 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.quota [None req-d3de05eb-0e91-4b83-b58d-0d95a54e4777 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Getting quotas for user 82da4b8f8bdb4dbab655ff510bfa328f and project dc518d9b31644a8d8b21cf9c645b1373. Resources: {'instances', 'cores', 'ram'} {{(pid=118886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 03:18:57.714859 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-d3de05eb-0e91-4b83-b58d-0d95a54e4777 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Going to run 1 instances... {{(pid=118886) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 03:18:57.717454 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-d3de05eb-0e91-4b83-b58d-0d95a54e4777 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] [instance: 96327956-efab-40b1-8b99-628ab19623be] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='df895798-2211-4403-8fb7-0333acd47a3e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 03:18:57.769667 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-d3de05eb-0e91-4b83-b58d-0d95a54e4777 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.749298 Oct 17 03:18:57.770348 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 451/867] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 03:18:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 751 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 03:18:57.783426 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-23ba1590-2fdd-4108-821b-721be8475ebc tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:18:57.784029 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-23ba1590-2fdd-4108-821b-721be8475ebc tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] [instance: 96327956-efab-40b1-8b99-628ab19623be] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:18:57.857782 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-23ba1590-2fdd-4108-821b-721be8475ebc tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82da4b8f8bdb4dbab655ff510bfa328f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc518d9b31644a8d8b21cf9c645b1373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:18:57.865704 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-23ba1590-2fdd-4108-821b-721be8475ebc tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] 10.222.0.27 "GET /compute/v2.1/servers/96327956-efab-40b1-8b99-628ab19623be" status: 200 len: 1258 microversion: 2.1 time: 0.086636 Oct 17 03:18:57.866279 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 417/868] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:18:57 2022] GET /compute/v2.1/servers/96327956-efab-40b1-8b99-628ab19623be => generated 1258 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:18:58.888844 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-d9b9fe9c-2552-4009-ba88-8dd25a25ba0e tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:18:58.890164 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-d9b9fe9c-2552-4009-ba88-8dd25a25ba0e tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] [instance: 96327956-efab-40b1-8b99-628ab19623be] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:18:58.898625 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-d9b9fe9c-2552-4009-ba88-8dd25a25ba0e tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:18:58.899416 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-d9b9fe9c-2552-4009-ba88-8dd25a25ba0e tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:18:58.900042 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-d9b9fe9c-2552-4009-ba88-8dd25a25ba0e tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:18:58.901602 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-d9b9fe9c-2552-4009-ba88-8dd25a25ba0e tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:18:58.902050 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-d9b9fe9c-2552-4009-ba88-8dd25a25ba0e tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:18:58.902627 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-d9b9fe9c-2552-4009-ba88-8dd25a25ba0e tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:18:59.007777 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-d9b9fe9c-2552-4009-ba88-8dd25a25ba0e tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82da4b8f8bdb4dbab655ff510bfa328f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc518d9b31644a8d8b21cf9c645b1373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:18:59.028709 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-d9b9fe9c-2552-4009-ba88-8dd25a25ba0e tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] 10.222.0.27 "GET /compute/v2.1/servers/96327956-efab-40b1-8b99-628ab19623be" status: 200 len: 1318 microversion: 2.1 time: 0.142869 Oct 17 03:18:59.029659 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 452/869] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:18:58 2022] GET /compute/v2.1/servers/96327956-efab-40b1-8b99-628ab19623be => generated 1318 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:19:00.058285 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-45e1ddc5-f897-4acf-9753-aae3b6740d79 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:19:00.059073 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-45e1ddc5-f897-4acf-9753-aae3b6740d79 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] [instance: 96327956-efab-40b1-8b99-628ab19623be] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:19:00.078632 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-45e1ddc5-f897-4acf-9753-aae3b6740d79 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:19:00.080438 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-45e1ddc5-f897-4acf-9753-aae3b6740d79 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:19:00.084440 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-45e1ddc5-f897-4acf-9753-aae3b6740d79 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:19:00.086303 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-45e1ddc5-f897-4acf-9753-aae3b6740d79 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:19:00.089866 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-45e1ddc5-f897-4acf-9753-aae3b6740d79 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:19:00.093680 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-45e1ddc5-f897-4acf-9753-aae3b6740d79 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:19:00.261043 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-45e1ddc5-f897-4acf-9753-aae3b6740d79 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82da4b8f8bdb4dbab655ff510bfa328f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc518d9b31644a8d8b21cf9c645b1373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:19:00.270495 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-45e1ddc5-f897-4acf-9753-aae3b6740d79 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] 10.222.0.27 "GET /compute/v2.1/servers/96327956-efab-40b1-8b99-628ab19623be" status: 200 len: 1316 microversion: 2.1 time: 0.220534 Oct 17 03:19:00.288241 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 418/870] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:19:00 2022] GET /compute/v2.1/servers/96327956-efab-40b1-8b99-628ab19623be => generated 1316 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:19:01.302281 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-cdcfedca-6171-4439-a131-87fd10dd2962 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:19:01.309920 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-cdcfedca-6171-4439-a131-87fd10dd2962 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] [instance: 96327956-efab-40b1-8b99-628ab19623be] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:19:01.326476 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-cdcfedca-6171-4439-a131-87fd10dd2962 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:19:01.328156 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-cdcfedca-6171-4439-a131-87fd10dd2962 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:19:01.330449 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-cdcfedca-6171-4439-a131-87fd10dd2962 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:19:01.332439 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-cdcfedca-6171-4439-a131-87fd10dd2962 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:19:01.334375 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-cdcfedca-6171-4439-a131-87fd10dd2962 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:19:01.335360 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-cdcfedca-6171-4439-a131-87fd10dd2962 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:19:01.835599 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-cdcfedca-6171-4439-a131-87fd10dd2962 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82da4b8f8bdb4dbab655ff510bfa328f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc518d9b31644a8d8b21cf9c645b1373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:19:01.852576 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-cdcfedca-6171-4439-a131-87fd10dd2962 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] 10.222.0.27 "GET /compute/v2.1/servers/96327956-efab-40b1-8b99-628ab19623be" status: 200 len: 1358 microversion: 2.1 time: 0.554702 Oct 17 03:19:01.853481 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 453/871] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:19:01 2022] GET /compute/v2.1/servers/96327956-efab-40b1-8b99-628ab19623be => generated 1358 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:19:02.361208 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [req-abb6545c-313f-4003-b34b-e82006507a61 req-16a7ef12-25ac-4abc-a776-eb6563f0479b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96327956-efab-40b1-8b99-628ab19623be", "tag": "ac441b28-2717-4b03-ba74-cb37f802decc"}]} {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:19:02.378247 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [req-abb6545c-313f-4003-b34b-e82006507a61 req-16a7ef12-25ac-4abc-a776-eb6563f0479b service nova] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:19:02.379305 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [req-abb6545c-313f-4003-b34b-e82006507a61 req-16a7ef12-25ac-4abc-a776-eb6563f0479b service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:19:02.379885 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [req-abb6545c-313f-4003-b34b-e82006507a61 req-16a7ef12-25ac-4abc-a776-eb6563f0479b service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:19:02.417778 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.compute.server_external_events [req-abb6545c-313f-4003-b34b-e82006507a61 req-16a7ef12-25ac-4abc-a776-eb6563f0479b service nova] Creating event network-changed:ac441b28-2717-4b03-ba74-cb37f802decc for instance 96327956-efab-40b1-8b99-628ab19623be on hv-cinder-84697 Oct 17 03:19:02.423328 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [req-abb6545c-313f-4003-b34b-e82006507a61 req-16a7ef12-25ac-4abc-a776-eb6563f0479b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066554 Oct 17 03:19:02.424138 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 419/872] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 03:19:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:19:02.885589 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-38481503-4e81-499e-bdc2-9272e8b217a8 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:19:02.887754 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-38481503-4e81-499e-bdc2-9272e8b217a8 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] [instance: 96327956-efab-40b1-8b99-628ab19623be] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:19:02.903672 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-38481503-4e81-499e-bdc2-9272e8b217a8 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:19:02.904305 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-38481503-4e81-499e-bdc2-9272e8b217a8 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:19:02.904802 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-38481503-4e81-499e-bdc2-9272e8b217a8 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:19:02.907145 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-38481503-4e81-499e-bdc2-9272e8b217a8 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:19:02.907613 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-38481503-4e81-499e-bdc2-9272e8b217a8 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:19:02.910613 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-38481503-4e81-499e-bdc2-9272e8b217a8 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:19:03.272114 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-38481503-4e81-499e-bdc2-9272e8b217a8 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82da4b8f8bdb4dbab655ff510bfa328f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc518d9b31644a8d8b21cf9c645b1373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:19:03.286268 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-38481503-4e81-499e-bdc2-9272e8b217a8 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] 10.222.0.27 "GET /compute/v2.1/servers/96327956-efab-40b1-8b99-628ab19623be" status: 200 len: 1358 microversion: 2.1 time: 0.413584 Oct 17 03:19:03.289721 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 454/873] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:19:02 2022] GET /compute/v2.1/servers/96327956-efab-40b1-8b99-628ab19623be => generated 1358 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:19:04.318947 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-dfdb09cf-6f1e-488e-ad6b-dcc2d9149d6f tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:19:04.320614 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-dfdb09cf-6f1e-488e-ad6b-dcc2d9149d6f tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] [instance: 96327956-efab-40b1-8b99-628ab19623be] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:19:04.330017 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-dfdb09cf-6f1e-488e-ad6b-dcc2d9149d6f tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:19:04.330678 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-dfdb09cf-6f1e-488e-ad6b-dcc2d9149d6f tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:19:04.331245 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-dfdb09cf-6f1e-488e-ad6b-dcc2d9149d6f tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:19:04.332045 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-dfdb09cf-6f1e-488e-ad6b-dcc2d9149d6f tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:19:04.332598 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-dfdb09cf-6f1e-488e-ad6b-dcc2d9149d6f tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:19:04.333148 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-dfdb09cf-6f1e-488e-ad6b-dcc2d9149d6f tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:19:04.513602 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-dfdb09cf-6f1e-488e-ad6b-dcc2d9149d6f tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82da4b8f8bdb4dbab655ff510bfa328f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc518d9b31644a8d8b21cf9c645b1373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:19:04.522371 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-dfdb09cf-6f1e-488e-ad6b-dcc2d9149d6f tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] 10.222.0.27 "GET /compute/v2.1/servers/96327956-efab-40b1-8b99-628ab19623be" status: 200 len: 1358 microversion: 2.1 time: 0.208874 Oct 17 03:19:04.532901 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 420/874] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:19:04 2022] GET /compute/v2.1/servers/96327956-efab-40b1-8b99-628ab19623be => generated 1358 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:19:05.545549 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-b85c133e-8473-4ab0-a8f6-bbb2c53fcc80 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:19:05.546945 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-b85c133e-8473-4ab0-a8f6-bbb2c53fcc80 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] [instance: 96327956-efab-40b1-8b99-628ab19623be] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:19:05.553968 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-b85c133e-8473-4ab0-a8f6-bbb2c53fcc80 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:19:05.554447 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-b85c133e-8473-4ab0-a8f6-bbb2c53fcc80 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:19:05.554953 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-b85c133e-8473-4ab0-a8f6-bbb2c53fcc80 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:19:05.555768 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-b85c133e-8473-4ab0-a8f6-bbb2c53fcc80 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:19:05.556398 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-b85c133e-8473-4ab0-a8f6-bbb2c53fcc80 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:19:05.557458 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-b85c133e-8473-4ab0-a8f6-bbb2c53fcc80 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:19:05.696263 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-b85c133e-8473-4ab0-a8f6-bbb2c53fcc80 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82da4b8f8bdb4dbab655ff510bfa328f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc518d9b31644a8d8b21cf9c645b1373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:19:05.705382 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-b85c133e-8473-4ab0-a8f6-bbb2c53fcc80 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] 10.222.0.27 "GET /compute/v2.1/servers/96327956-efab-40b1-8b99-628ab19623be" status: 200 len: 1358 microversion: 2.1 time: 0.163502 Oct 17 03:19:05.706036 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 455/875] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:19:05 2022] GET /compute/v2.1/servers/96327956-efab-40b1-8b99-628ab19623be => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:19:06.730490 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-78bda659-543d-41eb-bdcb-f30a85125b52 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:19:06.731178 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-78bda659-543d-41eb-bdcb-f30a85125b52 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] [instance: 96327956-efab-40b1-8b99-628ab19623be] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:19:06.737476 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-78bda659-543d-41eb-bdcb-f30a85125b52 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:19:06.737957 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-78bda659-543d-41eb-bdcb-f30a85125b52 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:19:06.738384 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-78bda659-543d-41eb-bdcb-f30a85125b52 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:19:06.739103 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-78bda659-543d-41eb-bdcb-f30a85125b52 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:19:06.739551 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-78bda659-543d-41eb-bdcb-f30a85125b52 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:19:06.739969 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-78bda659-543d-41eb-bdcb-f30a85125b52 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:19:06.881711 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-78bda659-543d-41eb-bdcb-f30a85125b52 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82da4b8f8bdb4dbab655ff510bfa328f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc518d9b31644a8d8b21cf9c645b1373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:19:06.890299 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-78bda659-543d-41eb-bdcb-f30a85125b52 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] 10.222.0.27 "GET /compute/v2.1/servers/96327956-efab-40b1-8b99-628ab19623be" status: 200 len: 1358 microversion: 2.1 time: 0.164470 Oct 17 03:19:06.890922 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 421/876] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:19:06 2022] GET /compute/v2.1/servers/96327956-efab-40b1-8b99-628ab19623be => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:19:07.913760 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-babb8648-2f8d-4aa7-be12-2e113290e430 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:19:07.915039 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-babb8648-2f8d-4aa7-be12-2e113290e430 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] [instance: 96327956-efab-40b1-8b99-628ab19623be] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:19:07.919341 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG dbcounter [-] [118886] Writing DB stats nova_cell0:SELECT=2 {{(pid=118886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:19:07.919979 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG dbcounter [-] [118886] Writing DB stats nova_cell0:SELECT=6 {{(pid=118886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:19:07.924900 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-babb8648-2f8d-4aa7-be12-2e113290e430 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:19:07.925491 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-babb8648-2f8d-4aa7-be12-2e113290e430 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:19:07.925984 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-babb8648-2f8d-4aa7-be12-2e113290e430 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:19:07.927085 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-babb8648-2f8d-4aa7-be12-2e113290e430 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:19:07.927606 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-babb8648-2f8d-4aa7-be12-2e113290e430 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:19:07.928356 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-babb8648-2f8d-4aa7-be12-2e113290e430 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:19:08.093609 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-babb8648-2f8d-4aa7-be12-2e113290e430 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82da4b8f8bdb4dbab655ff510bfa328f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc518d9b31644a8d8b21cf9c645b1373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:19:08.105888 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-babb8648-2f8d-4aa7-be12-2e113290e430 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] 10.222.0.27 "GET /compute/v2.1/servers/96327956-efab-40b1-8b99-628ab19623be" status: 200 len: 1358 microversion: 2.1 time: 0.196001 Oct 17 03:19:08.106462 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 456/877] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:19:07 2022] GET /compute/v2.1/servers/96327956-efab-40b1-8b99-628ab19623be => generated 1358 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:19:09.129401 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-a4e37acc-1042-40e5-bd53-d9eb33262a29 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:19:09.130034 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-a4e37acc-1042-40e5-bd53-d9eb33262a29 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] [instance: 96327956-efab-40b1-8b99-628ab19623be] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:19:09.132423 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG dbcounter [-] [118887] Writing DB stats nova_cell0:SELECT=6 {{(pid=118887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:19:09.137892 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-a4e37acc-1042-40e5-bd53-d9eb33262a29 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:19:09.138366 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-a4e37acc-1042-40e5-bd53-d9eb33262a29 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:19:09.138791 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-a4e37acc-1042-40e5-bd53-d9eb33262a29 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:19:09.139495 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-a4e37acc-1042-40e5-bd53-d9eb33262a29 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:19:09.139940 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-a4e37acc-1042-40e5-bd53-d9eb33262a29 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:19:09.140355 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-a4e37acc-1042-40e5-bd53-d9eb33262a29 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:19:09.279761 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-a4e37acc-1042-40e5-bd53-d9eb33262a29 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82da4b8f8bdb4dbab655ff510bfa328f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc518d9b31644a8d8b21cf9c645b1373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:19:09.287626 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-a4e37acc-1042-40e5-bd53-d9eb33262a29 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] 10.222.0.27 "GET /compute/v2.1/servers/96327956-efab-40b1-8b99-628ab19623be" status: 200 len: 1358 microversion: 2.1 time: 0.162087 Oct 17 03:19:09.288302 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 422/878] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:19:09 2022] GET /compute/v2.1/servers/96327956-efab-40b1-8b99-628ab19623be => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:19:10.311408 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-1bfc8595-4ba2-4c0b-acb4-6f3d3a37b353 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:19:10.312013 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-1bfc8595-4ba2-4c0b-acb4-6f3d3a37b353 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] [instance: 96327956-efab-40b1-8b99-628ab19623be] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:19:10.318382 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-1bfc8595-4ba2-4c0b-acb4-6f3d3a37b353 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:19:10.318853 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-1bfc8595-4ba2-4c0b-acb4-6f3d3a37b353 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:19:10.319330 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-1bfc8595-4ba2-4c0b-acb4-6f3d3a37b353 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:19:10.319993 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-1bfc8595-4ba2-4c0b-acb4-6f3d3a37b353 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:19:10.320438 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-1bfc8595-4ba2-4c0b-acb4-6f3d3a37b353 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:19:10.320852 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-1bfc8595-4ba2-4c0b-acb4-6f3d3a37b353 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:19:10.452248 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-1bfc8595-4ba2-4c0b-acb4-6f3d3a37b353 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82da4b8f8bdb4dbab655ff510bfa328f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc518d9b31644a8d8b21cf9c645b1373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:19:10.459700 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-1bfc8595-4ba2-4c0b-acb4-6f3d3a37b353 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] 10.222.0.27 "GET /compute/v2.1/servers/96327956-efab-40b1-8b99-628ab19623be" status: 200 len: 1358 microversion: 2.1 time: 0.152693 Oct 17 03:19:10.460288 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 457/879] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:19:10 2022] GET /compute/v2.1/servers/96327956-efab-40b1-8b99-628ab19623be => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:19:11.481885 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-fc520a4c-526e-47a1-9189-50c77d41aab0 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:19:11.482691 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-fc520a4c-526e-47a1-9189-50c77d41aab0 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] [instance: 96327956-efab-40b1-8b99-628ab19623be] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:19:11.489149 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-fc520a4c-526e-47a1-9189-50c77d41aab0 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:19:11.489626 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-fc520a4c-526e-47a1-9189-50c77d41aab0 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:19:11.490054 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-fc520a4c-526e-47a1-9189-50c77d41aab0 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:19:11.490743 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-fc520a4c-526e-47a1-9189-50c77d41aab0 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:19:11.491225 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-fc520a4c-526e-47a1-9189-50c77d41aab0 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:19:11.491648 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-fc520a4c-526e-47a1-9189-50c77d41aab0 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:19:11.661737 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-fc520a4c-526e-47a1-9189-50c77d41aab0 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82da4b8f8bdb4dbab655ff510bfa328f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc518d9b31644a8d8b21cf9c645b1373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:19:11.672950 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-fc520a4c-526e-47a1-9189-50c77d41aab0 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] 10.222.0.27 "GET /compute/v2.1/servers/96327956-efab-40b1-8b99-628ab19623be" status: 200 len: 1358 microversion: 2.1 time: 0.194865 Oct 17 03:19:11.674356 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 423/880] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:19:11 2022] GET /compute/v2.1/servers/96327956-efab-40b1-8b99-628ab19623be => generated 1358 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:19:11.749464 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [req-4e833fea-a09b-4931-bfd0-7be14f301171 req-f5ab58a6-f7db-43ae-97ec-046009a1c6a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96327956-efab-40b1-8b99-628ab19623be", "name": "network-vif-plugged", "status": "completed", "tag": "ac441b28-2717-4b03-ba74-cb37f802decc"}]} {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:19:11.768247 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [req-4e833fea-a09b-4931-bfd0-7be14f301171 req-f5ab58a6-f7db-43ae-97ec-046009a1c6a5 service nova] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:19:11.769202 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [req-4e833fea-a09b-4931-bfd0-7be14f301171 req-f5ab58a6-f7db-43ae-97ec-046009a1c6a5 service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:19:11.769629 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [req-4e833fea-a09b-4931-bfd0-7be14f301171 req-f5ab58a6-f7db-43ae-97ec-046009a1c6a5 service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:19:11.789443 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.compute.server_external_events [req-4e833fea-a09b-4931-bfd0-7be14f301171 req-f5ab58a6-f7db-43ae-97ec-046009a1c6a5 service nova] Creating event network-vif-plugged:ac441b28-2717-4b03-ba74-cb37f802decc for instance 96327956-efab-40b1-8b99-628ab19623be on hv-cinder-84697 Oct 17 03:19:11.795179 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [req-4e833fea-a09b-4931-bfd0-7be14f301171 req-f5ab58a6-f7db-43ae-97ec-046009a1c6a5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049459 Oct 17 03:19:11.795832 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 458/881] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 03:19:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:19:12.699055 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-95a7a75f-250b-4bbc-a01c-e389c9b7dd82 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:19:12.699646 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-95a7a75f-250b-4bbc-a01c-e389c9b7dd82 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] [instance: 96327956-efab-40b1-8b99-628ab19623be] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:19:12.706412 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-95a7a75f-250b-4bbc-a01c-e389c9b7dd82 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:19:12.706962 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-95a7a75f-250b-4bbc-a01c-e389c9b7dd82 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:19:12.707368 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-95a7a75f-250b-4bbc-a01c-e389c9b7dd82 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:19:12.708076 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-95a7a75f-250b-4bbc-a01c-e389c9b7dd82 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:19:12.708526 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-95a7a75f-250b-4bbc-a01c-e389c9b7dd82 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:19:12.708950 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-95a7a75f-250b-4bbc-a01c-e389c9b7dd82 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:19:12.847922 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-95a7a75f-250b-4bbc-a01c-e389c9b7dd82 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82da4b8f8bdb4dbab655ff510bfa328f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc518d9b31644a8d8b21cf9c645b1373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:19:12.859079 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-95a7a75f-250b-4bbc-a01c-e389c9b7dd82 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] 10.222.0.27 "GET /compute/v2.1/servers/96327956-efab-40b1-8b99-628ab19623be" status: 200 len: 1358 microversion: 2.1 time: 0.162246 Oct 17 03:19:12.859079 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 424/882] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:19:12 2022] GET /compute/v2.1/servers/96327956-efab-40b1-8b99-628ab19623be => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:19:13.884321 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-6df01fea-a3ab-410c-a8a9-b074e16df7af tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:19:13.885909 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-6df01fea-a3ab-410c-a8a9-b074e16df7af tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] [instance: 96327956-efab-40b1-8b99-628ab19623be] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:19:13.894130 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-6df01fea-a3ab-410c-a8a9-b074e16df7af tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:19:13.894641 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-6df01fea-a3ab-410c-a8a9-b074e16df7af tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:19:13.895107 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-6df01fea-a3ab-410c-a8a9-b074e16df7af tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:19:13.895799 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-6df01fea-a3ab-410c-a8a9-b074e16df7af tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:19:13.896283 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-6df01fea-a3ab-410c-a8a9-b074e16df7af tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:19:13.896671 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-6df01fea-a3ab-410c-a8a9-b074e16df7af tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:19:14.074833 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-6df01fea-a3ab-410c-a8a9-b074e16df7af tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82da4b8f8bdb4dbab655ff510bfa328f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc518d9b31644a8d8b21cf9c645b1373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:19:14.082569 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-6df01fea-a3ab-410c-a8a9-b074e16df7af tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] 10.222.0.27 "GET /compute/v2.1/servers/96327956-efab-40b1-8b99-628ab19623be" status: 200 len: 1547 microversion: 2.1 time: 0.204629 Oct 17 03:19:14.083185 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 459/883] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:19:13 2022] GET /compute/v2.1/servers/96327956-efab-40b1-8b99-628ab19623be => generated 1547 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:19:14.104895 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-69a3f567-bca1-4e9c-b4a5-481d189c175d tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:19:14.105507 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-69a3f567-bca1-4e9c-b4a5-481d189c175d tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] [instance: 96327956-efab-40b1-8b99-628ab19623be] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:19:14.111565 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-69a3f567-bca1-4e9c-b4a5-481d189c175d tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:19:14.112050 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-69a3f567-bca1-4e9c-b4a5-481d189c175d tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:19:14.112494 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-69a3f567-bca1-4e9c-b4a5-481d189c175d tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:19:14.113189 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-69a3f567-bca1-4e9c-b4a5-481d189c175d tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:19:14.113644 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-69a3f567-bca1-4e9c-b4a5-481d189c175d tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:19:14.114070 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-69a3f567-bca1-4e9c-b4a5-481d189c175d tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:19:14.268302 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-69a3f567-bca1-4e9c-b4a5-481d189c175d tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82da4b8f8bdb4dbab655ff510bfa328f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc518d9b31644a8d8b21cf9c645b1373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:19:14.276171 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-69a3f567-bca1-4e9c-b4a5-481d189c175d tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] 10.222.0.27 "GET /compute/v2.1/servers/96327956-efab-40b1-8b99-628ab19623be" status: 200 len: 1547 microversion: 2.1 time: 0.175353 Oct 17 03:19:14.277095 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 425/884] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:19:14 2022] GET /compute/v2.1/servers/96327956-efab-40b1-8b99-628ab19623be => generated 1547 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:19:14.299467 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-5ec393d8-520a-444c-b3eb-a0fa55d6ba24 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:19:14.304385 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-5ec393d8-520a-444c-b3eb-a0fa55d6ba24 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '82da4b8f8bdb4dbab655ff510bfa328f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc518d9b31644a8d8b21cf9c645b1373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:19:14.305156 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-5ec393d8-520a-444c-b3eb-a0fa55d6ba24 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Searching by: {'deleted': False, 'project_id': 'dc518d9b31644a8d8b21cf9c645b1373'} {{(pid=118886) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 03:19:14.312845 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-5ec393d8-520a-444c-b3eb-a0fa55d6ba24 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:19:14.313323 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-5ec393d8-520a-444c-b3eb-a0fa55d6ba24 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:19:14.313754 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-5ec393d8-520a-444c-b3eb-a0fa55d6ba24 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:19:14.314476 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-5ec393d8-520a-444c-b3eb-a0fa55d6ba24 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:19:14.315009 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-5ec393d8-520a-444c-b3eb-a0fa55d6ba24 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:19:14.315378 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-5ec393d8-520a-444c-b3eb-a0fa55d6ba24 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:19:14.566070 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.multi_cell_list [None req-5ec393d8-520a-444c-b3eb-a0fa55d6ba24 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=118886) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 17 03:19:14.668933 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-5ec393d8-520a-444c-b3eb-a0fa55d6ba24 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] 10.222.0.27 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.373350 Oct 17 03:19:14.669667 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 460/885] 10.222.0.27 () {58 vars in 1125 bytes} [Mon Oct 17 03:19:14 2022] GET /compute/v2.1/servers => generated 342 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:19:14.683303 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-6a61c643-d079-4966-84c0-deac8f85f4a8 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:19:14.683988 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-6a61c643-d079-4966-84c0-deac8f85f4a8 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] [instance: 96327956-efab-40b1-8b99-628ab19623be] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:19:14.690325 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-6a61c643-d079-4966-84c0-deac8f85f4a8 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:19:14.690957 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-6a61c643-d079-4966-84c0-deac8f85f4a8 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:19:14.691398 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-6a61c643-d079-4966-84c0-deac8f85f4a8 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:19:14.692209 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-6a61c643-d079-4966-84c0-deac8f85f4a8 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:19:14.695910 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-6a61c643-d079-4966-84c0-deac8f85f4a8 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:19:14.696401 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-6a61c643-d079-4966-84c0-deac8f85f4a8 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:19:14.833794 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-6a61c643-d079-4966-84c0-deac8f85f4a8 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82da4b8f8bdb4dbab655ff510bfa328f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc518d9b31644a8d8b21cf9c645b1373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:19:14.845346 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-6a61c643-d079-4966-84c0-deac8f85f4a8 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] 10.222.0.27 "GET /compute/v2.1/servers/96327956-efab-40b1-8b99-628ab19623be" status: 200 len: 1547 microversion: 2.1 time: 0.166227 Oct 17 03:19:14.845904 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 426/886] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:19:14 2022] GET /compute/v2.1/servers/96327956-efab-40b1-8b99-628ab19623be => generated 1547 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:19:16.474068 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-9e8897b5-7c8d-44f8-8eba-8fb43f9f004b tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c8015d08-b418-4d71-b694-721468009b40"}} {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:19:16.476291 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-9e8897b5-7c8d-44f8-8eba-8fb43f9f004b tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] [instance: 96327956-efab-40b1-8b99-628ab19623be] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:19:16.483343 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-9e8897b5-7c8d-44f8-8eba-8fb43f9f004b tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:19:16.483817 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-9e8897b5-7c8d-44f8-8eba-8fb43f9f004b tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:19:16.484245 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-9e8897b5-7c8d-44f8-8eba-8fb43f9f004b tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:19:16.484932 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-9e8897b5-7c8d-44f8-8eba-8fb43f9f004b tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:19:16.485380 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-9e8897b5-7c8d-44f8-8eba-8fb43f9f004b tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:19:16.485797 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-9e8897b5-7c8d-44f8-8eba-8fb43f9f004b tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:19:16.751225 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-9e8897b5-7c8d-44f8-8eba-8fb43f9f004b tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] 10.222.0.27 "POST /compute/v2.1/servers/96327956-efab-40b1-8b99-628ab19623be/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.280946 Oct 17 03:19:16.757857 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 461/887] 10.222.0.27 () {60 vars in 1323 bytes} [Mon Oct 17 03:19:16 2022] POST /compute/v2.1/servers/96327956-efab-40b1-8b99-628ab19623be/os-volume_attachments => generated 194 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:19:24.350731 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-03d60c9d-43df-4a0b-9c21-22a860310ada tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:19:24.351360 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-03d60c9d-43df-4a0b-9c21-22a860310ada tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] [instance: 96327956-efab-40b1-8b99-628ab19623be] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:19:24.354565 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG dbcounter [-] [118887] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=118887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:19:24.359694 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-03d60c9d-43df-4a0b-9c21-22a860310ada tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:19:24.360168 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-03d60c9d-43df-4a0b-9c21-22a860310ada tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:19:24.360594 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-03d60c9d-43df-4a0b-9c21-22a860310ada tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:19:24.361271 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-03d60c9d-43df-4a0b-9c21-22a860310ada tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:19:24.361716 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-03d60c9d-43df-4a0b-9c21-22a860310ada tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:19:24.362134 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-03d60c9d-43df-4a0b-9c21-22a860310ada tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:19:24.489872 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-03d60c9d-43df-4a0b-9c21-22a860310ada tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82da4b8f8bdb4dbab655ff510bfa328f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc518d9b31644a8d8b21cf9c645b1373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:19:24.498644 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-03d60c9d-43df-4a0b-9c21-22a860310ada tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] 10.222.0.27 "GET /compute/v2.1/servers/96327956-efab-40b1-8b99-628ab19623be" status: 200 len: 1593 microversion: 2.1 time: 0.151747 Oct 17 03:19:24.499230 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 427/888] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:19:24 2022] GET /compute/v2.1/servers/96327956-efab-40b1-8b99-628ab19623be => generated 1593 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:19:26.203087 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG dbcounter [-] [118886] Writing DB stats nova_cell0:SELECT=2 {{(pid=118886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:19:26.209305 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [req-d3f207d6-aa3e-48db-a7b5-fd60bf94fee3 req-d05e98da-c61d-4096-b921-ce7c4ce74e28 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96327956-efab-40b1-8b99-628ab19623be", "tag": "ac441b28-2717-4b03-ba74-cb37f802decc"}]} {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:19:26.214516 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG dbcounter [-] [118886] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=3 {{(pid=118886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:19:26.222775 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [req-d3f207d6-aa3e-48db-a7b5-fd60bf94fee3 req-d05e98da-c61d-4096-b921-ce7c4ce74e28 service nova] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:19:26.223587 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [req-d3f207d6-aa3e-48db-a7b5-fd60bf94fee3 req-d05e98da-c61d-4096-b921-ce7c4ce74e28 service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:19:26.224431 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [req-d3f207d6-aa3e-48db-a7b5-fd60bf94fee3 req-d05e98da-c61d-4096-b921-ce7c4ce74e28 service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:19:26.228090 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG dbcounter [-] [118886] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:19:26.245565 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.compute.server_external_events [req-d3f207d6-aa3e-48db-a7b5-fd60bf94fee3 req-d05e98da-c61d-4096-b921-ce7c4ce74e28 service nova] Creating event network-changed:ac441b28-2717-4b03-ba74-cb37f802decc for instance 96327956-efab-40b1-8b99-628ab19623be on hv-cinder-84697 Oct 17 03:19:26.251325 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [req-d3f207d6-aa3e-48db-a7b5-fd60bf94fee3 req-d05e98da-c61d-4096-b921-ce7c4ce74e28 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049462 Oct 17 03:19:26.252104 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 462/889] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 03:19:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:19:27.388443 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-3f7ad731-66f2-43f5-8802-e9b68e47a1ac tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-860597188"}} {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:19:27.388958 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-3f7ad731-66f2-43f5-8802-e9b68e47a1ac tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] [instance: 96327956-efab-40b1-8b99-628ab19623be] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:19:27.396203 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-3f7ad731-66f2-43f5-8802-e9b68e47a1ac tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:19:27.396701 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-3f7ad731-66f2-43f5-8802-e9b68e47a1ac tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:19:27.403006 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-3f7ad731-66f2-43f5-8802-e9b68e47a1ac tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:19:27.403770 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-3f7ad731-66f2-43f5-8802-e9b68e47a1ac tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:19:27.404242 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-3f7ad731-66f2-43f5-8802-e9b68e47a1ac tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:19:27.404671 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-3f7ad731-66f2-43f5-8802-e9b68e47a1ac tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:19:27.882593 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.network.security_group_api [None req-3f7ad731-66f2-43f5-8802-e9b68e47a1ac tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Adding security group d1049b4a-f0bc-41f5-920c-abf5f7633e3a to port ac441b28-2717-4b03-ba74-cb37f802decc Oct 17 03:19:28.279704 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-3f7ad731-66f2-43f5-8802-e9b68e47a1ac tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] 10.222.0.27 "POST /compute/v2.1/servers/96327956-efab-40b1-8b99-628ab19623be/action" status: 202 len: 0 microversion: 2.1 time: 0.895006 Oct 17 03:19:28.285232 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 428/890] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 03:19:27 2022] POST /compute/v2.1/servers/96327956-efab-40b1-8b99-628ab19623be/action => generated 0 bytes in 902 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 03:19:28.290557 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-b09c1d15-631a-40c1-be2f-eae8cec92dc1 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:19:28.293976 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-b09c1d15-631a-40c1-be2f-eae8cec92dc1 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] [instance: 96327956-efab-40b1-8b99-628ab19623be] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:19:28.300583 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-b09c1d15-631a-40c1-be2f-eae8cec92dc1 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:19:28.301330 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-b09c1d15-631a-40c1-be2f-eae8cec92dc1 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:19:28.301955 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-b09c1d15-631a-40c1-be2f-eae8cec92dc1 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:19:28.302847 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-b09c1d15-631a-40c1-be2f-eae8cec92dc1 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:19:28.303533 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-b09c1d15-631a-40c1-be2f-eae8cec92dc1 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:19:28.304307 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-b09c1d15-631a-40c1-be2f-eae8cec92dc1 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:19:28.327118 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [req-35630165-29a0-4fc2-9014-12e042d6b1e5 req-a2ea2f7a-7f98-4517-b46e-2120cb475e7e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96327956-efab-40b1-8b99-628ab19623be", "tag": "ac441b28-2717-4b03-ba74-cb37f802decc"}]} {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:19:28.340255 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [req-35630165-29a0-4fc2-9014-12e042d6b1e5 req-a2ea2f7a-7f98-4517-b46e-2120cb475e7e service nova] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:19:28.341109 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [req-35630165-29a0-4fc2-9014-12e042d6b1e5 req-a2ea2f7a-7f98-4517-b46e-2120cb475e7e service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:19:28.341723 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [req-35630165-29a0-4fc2-9014-12e042d6b1e5 req-a2ea2f7a-7f98-4517-b46e-2120cb475e7e service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:19:28.356619 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.compute.server_external_events [req-35630165-29a0-4fc2-9014-12e042d6b1e5 req-a2ea2f7a-7f98-4517-b46e-2120cb475e7e service nova] Creating event network-changed:ac441b28-2717-4b03-ba74-cb37f802decc for instance 96327956-efab-40b1-8b99-628ab19623be on hv-cinder-84697 Oct 17 03:19:28.362556 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [req-35630165-29a0-4fc2-9014-12e042d6b1e5 req-a2ea2f7a-7f98-4517-b46e-2120cb475e7e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042185 Oct 17 03:19:28.363432 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 429/891] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 03:19:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:19:28.477870 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-b09c1d15-631a-40c1-be2f-eae8cec92dc1 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82da4b8f8bdb4dbab655ff510bfa328f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc518d9b31644a8d8b21cf9c645b1373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:19:28.489711 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-b09c1d15-631a-40c1-be2f-eae8cec92dc1 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] 10.222.0.27 "GET /compute/v2.1/servers/96327956-efab-40b1-8b99-628ab19623be" status: 200 len: 1758 microversion: 2.1 time: 0.204126 Oct 17 03:19:28.491007 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 463/892] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:19:28 2022] GET /compute/v2.1/servers/96327956-efab-40b1-8b99-628ab19623be => generated 1758 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:20:02.880242 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG dbcounter [-] [118887] Writing DB stats nova_api:SELECT=5 {{(pid=118887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:20:02.882248 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG dbcounter [-] [118887] Writing DB stats nova_cell1:SELECT=62 {{(pid=118887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:20:03.210393 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-d51a64e0-b26f-4024-86ca-b61d9069d7d6 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Action: 'create', calling method: .version_select at 0x7fc7016ae700>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-153764123", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA29XY7minXiDRHQt0f0VJy6q66aq5kjNWWVmqWOMPeYBU25B81O8z6ufYjPoRk4sL/t0SsJd8FibO7Z/sJ1BfdD4VCmd2yx48/kl1uwbN8IT24meWatIpW+u4TxaxVwGQ=="}} {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:20:03.228683 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.quota [None req-d51a64e0-b26f-4024-86ca-b61d9069d7d6 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Getting quotas for project 917f1029c33f4607b398287532f2fb4b. Resources: {'key_pairs'} {{(pid=118887) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 03:20:03.233264 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.quota [None req-d51a64e0-b26f-4024-86ca-b61d9069d7d6 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Getting quotas for user 4d30a0379df643ff81e1ca01f3e26d3d and project 917f1029c33f4607b398287532f2fb4b. Resources: {'key_pairs'} {{(pid=118887) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 03:20:03.262544 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-d51a64e0-b26f-4024-86ca-b61d9069d7d6 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.385034 Oct 17 03:20:03.263435 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 430/893] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 17 03:20:02 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:20:07.523194 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-8d6f8219-5461-443b-9cc5-6f9a079bbdf2 tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1871715571", "imageRef": "e6d41914-f1bc-4b72-9113-1a69b3d0d83b", "flavorRef": "452"}} {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:20:07.530582 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG dbcounter [-] [118886] Writing DB stats nova_api:SELECT=3 {{(pid=118886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:20:07.531729 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG dbcounter [-] [118886] Writing DB stats nova_cell1:SELECT=7 {{(pid=118886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:20:07.601587 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.network.neutron [None req-8d6f8219-5461-443b-9cc5-6f9a079bbdf2 tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] validate_networks() for None {{(pid=118886) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 03:20:07.936933 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.virt.hardware [None req-8d6f8219-5461-443b-9cc5-6f9a079bbdf2 tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] Flavor limits 0:0:0 {{(pid=118886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 03:20:07.937504 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.virt.hardware [None req-8d6f8219-5461-443b-9cc5-6f9a079bbdf2 tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] Image limits 0:0:0 {{(pid=118886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 03:20:07.938102 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.virt.hardware [None req-8d6f8219-5461-443b-9cc5-6f9a079bbdf2 tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] Flavor pref 0:0:0 {{(pid=118886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 03:20:07.938579 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.virt.hardware [None req-8d6f8219-5461-443b-9cc5-6f9a079bbdf2 tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] Image pref 0:0:0 {{(pid=118886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 03:20:07.939176 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.virt.hardware [None req-8d6f8219-5461-443b-9cc5-6f9a079bbdf2 tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 03:20:07.949920 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-8d6f8219-5461-443b-9cc5-6f9a079bbdf2 tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:20:07.950496 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-8d6f8219-5461-443b-9cc5-6f9a079bbdf2 tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:20:07.952582 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-8d6f8219-5461-443b-9cc5-6f9a079bbdf2 tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:20:07.953446 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-8d6f8219-5461-443b-9cc5-6f9a079bbdf2 tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:20:07.953979 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-8d6f8219-5461-443b-9cc5-6f9a079bbdf2 tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:20:07.954475 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-8d6f8219-5461-443b-9cc5-6f9a079bbdf2 tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:20:07.974121 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.quota [None req-8d6f8219-5461-443b-9cc5-6f9a079bbdf2 tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] Getting quotas for project b681923b7d7b4cf682ae41fdce65a823. Resources: {'instances', 'cores', 'ram'} {{(pid=118886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 03:20:07.978715 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.quota [None req-8d6f8219-5461-443b-9cc5-6f9a079bbdf2 tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] Getting quotas for user 1ba9dfbbcb5c424da17e7b198aef35d9 and project b681923b7d7b4cf682ae41fdce65a823. Resources: {'instances', 'cores', 'ram'} {{(pid=118886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 03:20:07.992841 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-8d6f8219-5461-443b-9cc5-6f9a079bbdf2 tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] Going to run 1 instances... {{(pid=118886) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 03:20:07.995276 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-8d6f8219-5461-443b-9cc5-6f9a079bbdf2 tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] [instance: 749d21a5-9d48-4053-abc6-5e4f7132a5fd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e6d41914-f1bc-4b72-9113-1a69b3d0d83b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 03:20:08.047428 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-8d6f8219-5461-443b-9cc5-6f9a079bbdf2 tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.529455 Oct 17 03:20:08.048498 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 464/894] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 03:20:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 531 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 03:20:08.060160 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-086f6b00-d544-4e96-829f-8235c098aef9 tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:20:08.060896 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-086f6b00-d544-4e96-829f-8235c098aef9 tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] [instance: 749d21a5-9d48-4053-abc6-5e4f7132a5fd] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:20:08.128949 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-086f6b00-d544-4e96-829f-8235c098aef9 tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ba9dfbbcb5c424da17e7b198aef35d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681923b7d7b4cf682ae41fdce65a823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:20:08.136360 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-086f6b00-d544-4e96-829f-8235c098aef9 tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] 10.222.0.27 "GET /compute/v2.1/servers/749d21a5-9d48-4053-abc6-5e4f7132a5fd" status: 200 len: 1215 microversion: 2.1 time: 0.080741 Oct 17 03:20:08.151193 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 431/895] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:20:08 2022] GET /compute/v2.1/servers/749d21a5-9d48-4053-abc6-5e4f7132a5fd => generated 1215 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:20:09.162349 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-e0bdc567-0da7-4cd8-b268-1bba0d88e174 tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:20:09.163038 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-e0bdc567-0da7-4cd8-b268-1bba0d88e174 tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] [instance: 749d21a5-9d48-4053-abc6-5e4f7132a5fd] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:20:09.215445 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-e0bdc567-0da7-4cd8-b268-1bba0d88e174 tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ba9dfbbcb5c424da17e7b198aef35d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681923b7d7b4cf682ae41fdce65a823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:20:09.223526 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-e0bdc567-0da7-4cd8-b268-1bba0d88e174 tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] 10.222.0.27 "GET /compute/v2.1/servers/749d21a5-9d48-4053-abc6-5e4f7132a5fd" status: 200 len: 1215 microversion: 2.1 time: 0.065899 Oct 17 03:20:09.224115 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 465/896] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:20:09 2022] GET /compute/v2.1/servers/749d21a5-9d48-4053-abc6-5e4f7132a5fd => generated 1215 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:20:10.245264 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-7123a406-8dad-44f4-b596-6dcaf994cdaf tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:20:10.245879 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-7123a406-8dad-44f4-b596-6dcaf994cdaf tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] [instance: 749d21a5-9d48-4053-abc6-5e4f7132a5fd] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:20:10.305684 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-7123a406-8dad-44f4-b596-6dcaf994cdaf tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ba9dfbbcb5c424da17e7b198aef35d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681923b7d7b4cf682ae41fdce65a823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:20:10.313141 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-7123a406-8dad-44f4-b596-6dcaf994cdaf tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] 10.222.0.27 "GET /compute/v2.1/servers/749d21a5-9d48-4053-abc6-5e4f7132a5fd" status: 200 len: 1215 microversion: 2.1 time: 0.071576 Oct 17 03:20:10.313730 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 432/897] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:20:10 2022] GET /compute/v2.1/servers/749d21a5-9d48-4053-abc6-5e4f7132a5fd => generated 1215 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:20:11.337348 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-3f295cd6-362a-41a5-b52c-34732195820c tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:20:11.342478 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-3f295cd6-362a-41a5-b52c-34732195820c tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] [instance: 96327956-efab-40b1-8b99-628ab19623be] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:20:11.345642 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-1f9c9ad4-a61e-4fb3-acf9-78819a7dc072 tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:20:11.347655 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-1f9c9ad4-a61e-4fb3-acf9-78819a7dc072 tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] [instance: 749d21a5-9d48-4053-abc6-5e4f7132a5fd] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:20:11.353043 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-3f295cd6-362a-41a5-b52c-34732195820c tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:20:11.353733 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-3f295cd6-362a-41a5-b52c-34732195820c tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:20:11.354174 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-3f295cd6-362a-41a5-b52c-34732195820c tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:20:11.355080 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-3f295cd6-362a-41a5-b52c-34732195820c tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:20:11.355622 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-3f295cd6-362a-41a5-b52c-34732195820c tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:20:11.356086 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-3f295cd6-362a-41a5-b52c-34732195820c tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:20:11.483168 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-3f295cd6-362a-41a5-b52c-34732195820c tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] 10.222.0.27 "POST /compute/v2.1/servers/96327956-efab-40b1-8b99-628ab19623be/action" status: 202 len: 0 microversion: 2.1 time: 0.148691 Oct 17 03:20:11.484401 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 466/898] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 03:20:11 2022] POST /compute/v2.1/servers/96327956-efab-40b1-8b99-628ab19623be/action => generated 0 bytes in 152 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 03:20:11.499169 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-a73321ac-601e-41ec-80f3-6442efe76145 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:20:11.501674 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-1f9c9ad4-a61e-4fb3-acf9-78819a7dc072 tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ba9dfbbcb5c424da17e7b198aef35d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681923b7d7b4cf682ae41fdce65a823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:20:11.506897 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-a73321ac-601e-41ec-80f3-6442efe76145 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] [instance: 96327956-efab-40b1-8b99-628ab19623be] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:20:11.509850 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-1f9c9ad4-a61e-4fb3-acf9-78819a7dc072 tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] 10.222.0.27 "GET /compute/v2.1/servers/749d21a5-9d48-4053-abc6-5e4f7132a5fd" status: 200 len: 1215 microversion: 2.1 time: 0.176801 Oct 17 03:20:11.510489 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 433/899] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:20:11 2022] GET /compute/v2.1/servers/749d21a5-9d48-4053-abc6-5e4f7132a5fd => generated 1215 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:20:11.520827 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-a73321ac-601e-41ec-80f3-6442efe76145 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:20:11.521394 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-a73321ac-601e-41ec-80f3-6442efe76145 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:20:11.521842 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-a73321ac-601e-41ec-80f3-6442efe76145 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:20:11.522556 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-a73321ac-601e-41ec-80f3-6442efe76145 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:20:11.523120 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-a73321ac-601e-41ec-80f3-6442efe76145 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:20:11.523556 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-a73321ac-601e-41ec-80f3-6442efe76145 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:20:11.691114 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-a73321ac-601e-41ec-80f3-6442efe76145 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82da4b8f8bdb4dbab655ff510bfa328f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc518d9b31644a8d8b21cf9c645b1373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:20:11.699623 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-a73321ac-601e-41ec-80f3-6442efe76145 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] 10.222.0.27 "GET /compute/v2.1/servers/96327956-efab-40b1-8b99-628ab19623be" status: 200 len: 1750 microversion: 2.1 time: 0.207759 Oct 17 03:20:11.700201 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 467/900] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:20:11 2022] GET /compute/v2.1/servers/96327956-efab-40b1-8b99-628ab19623be => generated 1750 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:20:12.538302 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-56c9aebb-ab81-443d-9024-9a99b0d2e4fa tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:20:12.539174 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-56c9aebb-ab81-443d-9024-9a99b0d2e4fa tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] [instance: 749d21a5-9d48-4053-abc6-5e4f7132a5fd] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:20:12.546016 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-56c9aebb-ab81-443d-9024-9a99b0d2e4fa tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:20:12.546496 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-56c9aebb-ab81-443d-9024-9a99b0d2e4fa tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:20:12.546966 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-56c9aebb-ab81-443d-9024-9a99b0d2e4fa tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:20:12.547656 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-56c9aebb-ab81-443d-9024-9a99b0d2e4fa tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:20:12.548109 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-56c9aebb-ab81-443d-9024-9a99b0d2e4fa tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:20:12.548529 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-56c9aebb-ab81-443d-9024-9a99b0d2e4fa tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:20:12.615789 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-56c9aebb-ab81-443d-9024-9a99b0d2e4fa tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ba9dfbbcb5c424da17e7b198aef35d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681923b7d7b4cf682ae41fdce65a823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:20:12.628944 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-56c9aebb-ab81-443d-9024-9a99b0d2e4fa tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] 10.222.0.27 "GET /compute/v2.1/servers/749d21a5-9d48-4053-abc6-5e4f7132a5fd" status: 200 len: 1219 microversion: 2.1 time: 0.092801 Oct 17 03:20:12.628944 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 434/901] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:20:12 2022] GET /compute/v2.1/servers/749d21a5-9d48-4053-abc6-5e4f7132a5fd => generated 1219 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:20:12.724186 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-c9b5bb84-c4d4-4108-9d93-ac808d776b07 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:20:12.724802 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-c9b5bb84-c4d4-4108-9d93-ac808d776b07 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] [instance: 96327956-efab-40b1-8b99-628ab19623be] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:20:12.732292 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-c9b5bb84-c4d4-4108-9d93-ac808d776b07 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:20:12.732794 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-c9b5bb84-c4d4-4108-9d93-ac808d776b07 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:20:12.733416 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-c9b5bb84-c4d4-4108-9d93-ac808d776b07 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:20:12.734125 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-c9b5bb84-c4d4-4108-9d93-ac808d776b07 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:20:12.735193 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-c9b5bb84-c4d4-4108-9d93-ac808d776b07 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:20:12.739504 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-c9b5bb84-c4d4-4108-9d93-ac808d776b07 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:20:12.917184 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-c9b5bb84-c4d4-4108-9d93-ac808d776b07 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82da4b8f8bdb4dbab655ff510bfa328f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc518d9b31644a8d8b21cf9c645b1373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:20:12.925857 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-c9b5bb84-c4d4-4108-9d93-ac808d776b07 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] 10.222.0.27 "GET /compute/v2.1/servers/96327956-efab-40b1-8b99-628ab19623be" status: 200 len: 1755 microversion: 2.1 time: 0.206584 Oct 17 03:20:12.926441 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 468/902] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:20:12 2022] GET /compute/v2.1/servers/96327956-efab-40b1-8b99-628ab19623be => generated 1755 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:20:13.654114 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-f2767a1a-bb18-457b-bd16-225a82fe8061 tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:20:13.655387 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-f2767a1a-bb18-457b-bd16-225a82fe8061 tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] [instance: 749d21a5-9d48-4053-abc6-5e4f7132a5fd] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:20:13.667935 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-f2767a1a-bb18-457b-bd16-225a82fe8061 tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:20:13.668853 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-f2767a1a-bb18-457b-bd16-225a82fe8061 tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:20:13.669510 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-f2767a1a-bb18-457b-bd16-225a82fe8061 tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:20:13.670630 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-f2767a1a-bb18-457b-bd16-225a82fe8061 tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:20:13.671332 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-f2767a1a-bb18-457b-bd16-225a82fe8061 tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:20:13.672307 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-f2767a1a-bb18-457b-bd16-225a82fe8061 tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:20:13.780148 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-f2767a1a-bb18-457b-bd16-225a82fe8061 tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ba9dfbbcb5c424da17e7b198aef35d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681923b7d7b4cf682ae41fdce65a823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:20:13.790605 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-f2767a1a-bb18-457b-bd16-225a82fe8061 tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] 10.222.0.27 "GET /compute/v2.1/servers/749d21a5-9d48-4053-abc6-5e4f7132a5fd" status: 200 len: 1285 microversion: 2.1 time: 0.140820 Oct 17 03:20:13.803767 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 435/903] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:20:13 2022] GET /compute/v2.1/servers/749d21a5-9d48-4053-abc6-5e4f7132a5fd => generated 1285 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:20:13.951622 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-5e88aa59-a6bd-495c-accd-c79af6582b90 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:20:13.952223 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-5e88aa59-a6bd-495c-accd-c79af6582b90 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] [instance: 96327956-efab-40b1-8b99-628ab19623be] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:20:13.955023 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 17 03:20:13.955160 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Mon Oct 17 03:20:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/96327956-efab-40b1-8b99-628ab19623be (ip 10.222.0.27) !!! Oct 17 03:20:13.961488 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-5e88aa59-a6bd-495c-accd-c79af6582b90 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:20:13.961967 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-5e88aa59-a6bd-495c-accd-c79af6582b90 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:20:13.962394 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-5e88aa59-a6bd-495c-accd-c79af6582b90 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:20:13.963350 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-5e88aa59-a6bd-495c-accd-c79af6582b90 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:20:13.963811 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-5e88aa59-a6bd-495c-accd-c79af6582b90 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:20:13.964304 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-5e88aa59-a6bd-495c-accd-c79af6582b90 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:20:14.118736 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-5e88aa59-a6bd-495c-accd-c79af6582b90 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82da4b8f8bdb4dbab655ff510bfa328f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc518d9b31644a8d8b21cf9c645b1373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:20:14.129803 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-5e88aa59-a6bd-495c-accd-c79af6582b90 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] 10.222.0.27 "GET /compute/v2.1/servers/96327956-efab-40b1-8b99-628ab19623be" status: 200 len: 1755 microversion: 2.1 time: 0.181624 Oct 17 03:20:14.130612 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 469/904] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:20:13 2022] GET /compute/v2.1/servers/96327956-efab-40b1-8b99-628ab19623be => generated 1755 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:20:14.815096 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-e4ca4a54-57cd-43e6-85b6-3c99121515ac tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:20:14.815941 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-e4ca4a54-57cd-43e6-85b6-3c99121515ac tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] [instance: 749d21a5-9d48-4053-abc6-5e4f7132a5fd] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:20:14.821831 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-e4ca4a54-57cd-43e6-85b6-3c99121515ac tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:20:14.822313 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-e4ca4a54-57cd-43e6-85b6-3c99121515ac tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:20:14.822746 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-e4ca4a54-57cd-43e6-85b6-3c99121515ac tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:20:14.823470 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-e4ca4a54-57cd-43e6-85b6-3c99121515ac tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:20:14.823961 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-e4ca4a54-57cd-43e6-85b6-3c99121515ac tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:20:14.824515 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-e4ca4a54-57cd-43e6-85b6-3c99121515ac tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:20:15.153940 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-d91f9ee3-0e63-48a4-ba6a-34ac491aa91d tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:20:15.154793 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-d91f9ee3-0e63-48a4-ba6a-34ac491aa91d tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] [instance: 96327956-efab-40b1-8b99-628ab19623be] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:20:15.161659 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-d91f9ee3-0e63-48a4-ba6a-34ac491aa91d tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:20:15.162217 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-d91f9ee3-0e63-48a4-ba6a-34ac491aa91d tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:20:15.162683 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-d91f9ee3-0e63-48a4-ba6a-34ac491aa91d tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:20:15.163407 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-d91f9ee3-0e63-48a4-ba6a-34ac491aa91d tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:20:15.164110 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-d91f9ee3-0e63-48a4-ba6a-34ac491aa91d tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:20:15.164524 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-d91f9ee3-0e63-48a4-ba6a-34ac491aa91d tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:20:15.294226 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-e4ca4a54-57cd-43e6-85b6-3c99121515ac tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ba9dfbbcb5c424da17e7b198aef35d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681923b7d7b4cf682ae41fdce65a823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:20:15.303219 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-e4ca4a54-57cd-43e6-85b6-3c99121515ac tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] 10.222.0.27 "GET /compute/v2.1/servers/749d21a5-9d48-4053-abc6-5e4f7132a5fd" status: 200 len: 1315 microversion: 2.1 time: 0.492048 Oct 17 03:20:15.303803 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 436/905] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:20:14 2022] GET /compute/v2.1/servers/749d21a5-9d48-4053-abc6-5e4f7132a5fd => generated 1315 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:20:15.320686 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-d91f9ee3-0e63-48a4-ba6a-34ac491aa91d tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82da4b8f8bdb4dbab655ff510bfa328f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc518d9b31644a8d8b21cf9c645b1373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:20:15.338748 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-d91f9ee3-0e63-48a4-ba6a-34ac491aa91d tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] 10.222.0.27 "GET /compute/v2.1/servers/96327956-efab-40b1-8b99-628ab19623be" status: 200 len: 1755 microversion: 2.1 time: 0.188495 Oct 17 03:20:15.339478 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 470/906] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:20:15 2022] GET /compute/v2.1/servers/96327956-efab-40b1-8b99-628ab19623be => generated 1755 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:20:15.627575 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [req-04c31334-0367-44b9-be45-e0886aaee4f3 req-bc0f93fc-d45f-4c8e-93f1-9d155dddd332 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "749d21a5-9d48-4053-abc6-5e4f7132a5fd", "tag": "060e3d64-708f-4d76-aeed-10f8c3526c37"}]} {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:20:15.638055 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [req-04c31334-0367-44b9-be45-e0886aaee4f3 req-bc0f93fc-d45f-4c8e-93f1-9d155dddd332 service nova] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:20:15.638543 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [req-04c31334-0367-44b9-be45-e0886aaee4f3 req-bc0f93fc-d45f-4c8e-93f1-9d155dddd332 service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:20:15.639006 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [req-04c31334-0367-44b9-be45-e0886aaee4f3 req-bc0f93fc-d45f-4c8e-93f1-9d155dddd332 service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:20:15.650553 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.compute.server_external_events [req-04c31334-0367-44b9-be45-e0886aaee4f3 req-bc0f93fc-d45f-4c8e-93f1-9d155dddd332 service nova] Creating event network-changed:060e3d64-708f-4d76-aeed-10f8c3526c37 for instance 749d21a5-9d48-4053-abc6-5e4f7132a5fd on hv-cinder-84697 Oct 17 03:20:15.655529 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [req-04c31334-0367-44b9-be45-e0886aaee4f3 req-bc0f93fc-d45f-4c8e-93f1-9d155dddd332 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031625 Oct 17 03:20:15.656189 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 437/907] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 03:20:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:20:16.327822 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-5f67647f-9a87-48a6-9ca3-e5f9ca2d907c tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:20:16.328438 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-5f67647f-9a87-48a6-9ca3-e5f9ca2d907c tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] [instance: 749d21a5-9d48-4053-abc6-5e4f7132a5fd] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:20:16.335625 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-5f67647f-9a87-48a6-9ca3-e5f9ca2d907c tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:20:16.336106 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-5f67647f-9a87-48a6-9ca3-e5f9ca2d907c tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:20:16.336539 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-5f67647f-9a87-48a6-9ca3-e5f9ca2d907c tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:20:16.337224 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-5f67647f-9a87-48a6-9ca3-e5f9ca2d907c tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:20:16.337674 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-5f67647f-9a87-48a6-9ca3-e5f9ca2d907c tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:20:16.338095 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-5f67647f-9a87-48a6-9ca3-e5f9ca2d907c tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:20:16.364632 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-718c3f6f-aef9-46d8-b264-7de42a963e99 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:20:16.365385 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-718c3f6f-aef9-46d8-b264-7de42a963e99 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] [instance: 96327956-efab-40b1-8b99-628ab19623be] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:20:16.371529 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-718c3f6f-aef9-46d8-b264-7de42a963e99 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:20:16.372004 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-718c3f6f-aef9-46d8-b264-7de42a963e99 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:20:16.372428 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-718c3f6f-aef9-46d8-b264-7de42a963e99 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:20:16.373147 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-718c3f6f-aef9-46d8-b264-7de42a963e99 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:20:16.373614 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-718c3f6f-aef9-46d8-b264-7de42a963e99 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:20:16.374015 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-718c3f6f-aef9-46d8-b264-7de42a963e99 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:20:16.469231 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-5f67647f-9a87-48a6-9ca3-e5f9ca2d907c tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ba9dfbbcb5c424da17e7b198aef35d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681923b7d7b4cf682ae41fdce65a823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:20:16.477850 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-5f67647f-9a87-48a6-9ca3-e5f9ca2d907c tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] 10.222.0.27 "GET /compute/v2.1/servers/749d21a5-9d48-4053-abc6-5e4f7132a5fd" status: 200 len: 1315 microversion: 2.1 time: 0.153755 Oct 17 03:20:16.478362 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 471/908] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:20:16 2022] GET /compute/v2.1/servers/749d21a5-9d48-4053-abc6-5e4f7132a5fd => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:20:16.522257 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-718c3f6f-aef9-46d8-b264-7de42a963e99 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82da4b8f8bdb4dbab655ff510bfa328f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc518d9b31644a8d8b21cf9c645b1373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:20:16.530477 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-718c3f6f-aef9-46d8-b264-7de42a963e99 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] 10.222.0.27 "GET /compute/v2.1/servers/96327956-efab-40b1-8b99-628ab19623be" status: 200 len: 1755 microversion: 2.1 time: 0.171117 Oct 17 03:20:16.531065 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 438/909] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:20:16 2022] GET /compute/v2.1/servers/96327956-efab-40b1-8b99-628ab19623be => generated 1755 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:20:17.500292 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-b18cf1a7-6cb5-4275-b724-3c9c1e942696 tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:20:17.500902 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-b18cf1a7-6cb5-4275-b724-3c9c1e942696 tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] [instance: 749d21a5-9d48-4053-abc6-5e4f7132a5fd] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:20:17.507527 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-b18cf1a7-6cb5-4275-b724-3c9c1e942696 tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:20:17.508010 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-b18cf1a7-6cb5-4275-b724-3c9c1e942696 tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:20:17.508445 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-b18cf1a7-6cb5-4275-b724-3c9c1e942696 tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:20:17.509132 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-b18cf1a7-6cb5-4275-b724-3c9c1e942696 tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:20:17.509584 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-b18cf1a7-6cb5-4275-b724-3c9c1e942696 tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:20:17.510027 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-b18cf1a7-6cb5-4275-b724-3c9c1e942696 tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:20:17.554066 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-71332730-3a93-4f69-90e1-5a7c9b8c3cac tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:20:17.554679 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-71332730-3a93-4f69-90e1-5a7c9b8c3cac tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] [instance: 96327956-efab-40b1-8b99-628ab19623be] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:20:17.561058 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-71332730-3a93-4f69-90e1-5a7c9b8c3cac tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:20:17.561544 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-71332730-3a93-4f69-90e1-5a7c9b8c3cac tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:20:17.561991 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-71332730-3a93-4f69-90e1-5a7c9b8c3cac tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:20:17.562692 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-71332730-3a93-4f69-90e1-5a7c9b8c3cac tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:20:17.563177 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-71332730-3a93-4f69-90e1-5a7c9b8c3cac tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:20:17.563606 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-71332730-3a93-4f69-90e1-5a7c9b8c3cac tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:20:17.636426 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-b18cf1a7-6cb5-4275-b724-3c9c1e942696 tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ba9dfbbcb5c424da17e7b198aef35d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681923b7d7b4cf682ae41fdce65a823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:20:17.644225 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-b18cf1a7-6cb5-4275-b724-3c9c1e942696 tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] 10.222.0.27 "GET /compute/v2.1/servers/749d21a5-9d48-4053-abc6-5e4f7132a5fd" status: 200 len: 1315 microversion: 2.1 time: 0.147692 Oct 17 03:20:17.644796 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 472/910] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:20:17 2022] GET /compute/v2.1/servers/749d21a5-9d48-4053-abc6-5e4f7132a5fd => generated 1315 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:20:17.704600 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-71332730-3a93-4f69-90e1-5a7c9b8c3cac tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82da4b8f8bdb4dbab655ff510bfa328f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc518d9b31644a8d8b21cf9c645b1373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:20:17.713292 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-71332730-3a93-4f69-90e1-5a7c9b8c3cac tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] 10.222.0.27 "GET /compute/v2.1/servers/96327956-efab-40b1-8b99-628ab19623be" status: 200 len: 1755 microversion: 2.1 time: 0.163771 Oct 17 03:20:17.713845 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 439/911] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:20:17 2022] GET /compute/v2.1/servers/96327956-efab-40b1-8b99-628ab19623be => generated 1755 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:20:18.668065 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-5412522b-aa27-4a5f-93d6-f45e6c35d729 tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:20:18.668779 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-5412522b-aa27-4a5f-93d6-f45e6c35d729 tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] [instance: 749d21a5-9d48-4053-abc6-5e4f7132a5fd] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:20:18.670720 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG dbcounter [-] [118886] Writing DB stats nova_cell0:SELECT=2 {{(pid=118886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:20:18.676627 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-5412522b-aa27-4a5f-93d6-f45e6c35d729 tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:20:18.677338 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-5412522b-aa27-4a5f-93d6-f45e6c35d729 tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:20:18.677773 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-5412522b-aa27-4a5f-93d6-f45e6c35d729 tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:20:18.678484 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-5412522b-aa27-4a5f-93d6-f45e6c35d729 tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:20:18.678957 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-5412522b-aa27-4a5f-93d6-f45e6c35d729 tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:20:18.679382 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-5412522b-aa27-4a5f-93d6-f45e6c35d729 tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:20:18.737677 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-ac082739-d85c-4f49-8367-5d21dd93182a tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:20:18.738300 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-ac082739-d85c-4f49-8367-5d21dd93182a tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] [instance: 96327956-efab-40b1-8b99-628ab19623be] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:20:18.744768 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-ac082739-d85c-4f49-8367-5d21dd93182a tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:20:18.745254 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-ac082739-d85c-4f49-8367-5d21dd93182a tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:20:18.745688 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-ac082739-d85c-4f49-8367-5d21dd93182a tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:20:18.746389 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-ac082739-d85c-4f49-8367-5d21dd93182a tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:20:18.746844 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-ac082739-d85c-4f49-8367-5d21dd93182a tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:20:18.747292 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-ac082739-d85c-4f49-8367-5d21dd93182a tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:20:18.880190 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-5412522b-aa27-4a5f-93d6-f45e6c35d729 tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ba9dfbbcb5c424da17e7b198aef35d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681923b7d7b4cf682ae41fdce65a823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:20:18.888008 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-5412522b-aa27-4a5f-93d6-f45e6c35d729 tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] 10.222.0.27 "GET /compute/v2.1/servers/749d21a5-9d48-4053-abc6-5e4f7132a5fd" status: 200 len: 1315 microversion: 2.1 time: 0.224231 Oct 17 03:20:18.899911 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-ac082739-d85c-4f49-8367-5d21dd93182a tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82da4b8f8bdb4dbab655ff510bfa328f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc518d9b31644a8d8b21cf9c645b1373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:20:18.903051 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 473/912] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:20:18 2022] GET /compute/v2.1/servers/749d21a5-9d48-4053-abc6-5e4f7132a5fd => generated 1315 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:20:18.908950 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-ac082739-d85c-4f49-8367-5d21dd93182a tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] 10.222.0.27 "GET /compute/v2.1/servers/96327956-efab-40b1-8b99-628ab19623be" status: 200 len: 1755 microversion: 2.1 time: 0.175740 Oct 17 03:20:18.909634 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 440/913] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:20:18 2022] GET /compute/v2.1/servers/96327956-efab-40b1-8b99-628ab19623be => generated 1755 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:20:19.913024 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-c8328805-e4ec-4d67-ac62-f02ee5cd5141 tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:20:19.913938 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-c8328805-e4ec-4d67-ac62-f02ee5cd5141 tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] [instance: 749d21a5-9d48-4053-abc6-5e4f7132a5fd] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:20:19.917273 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG dbcounter [-] [118886] Writing DB stats nova_cell0:SELECT=8 {{(pid=118886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:20:19.921830 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-c8328805-e4ec-4d67-ac62-f02ee5cd5141 tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:20:19.922344 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-c8328805-e4ec-4d67-ac62-f02ee5cd5141 tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:20:19.922780 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-c8328805-e4ec-4d67-ac62-f02ee5cd5141 tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:20:19.923553 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-c8328805-e4ec-4d67-ac62-f02ee5cd5141 tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:20:19.924005 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-c8328805-e4ec-4d67-ac62-f02ee5cd5141 tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:20:19.924430 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-c8328805-e4ec-4d67-ac62-f02ee5cd5141 tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:20:19.933986 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-d8082660-0913-4649-a44e-0287f0992393 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:20:19.934822 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-d8082660-0913-4649-a44e-0287f0992393 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] [instance: 96327956-efab-40b1-8b99-628ab19623be] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:20:19.943764 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-d8082660-0913-4649-a44e-0287f0992393 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:20:19.944364 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-d8082660-0913-4649-a44e-0287f0992393 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:20:19.944864 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-d8082660-0913-4649-a44e-0287f0992393 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:20:19.945783 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-d8082660-0913-4649-a44e-0287f0992393 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:20:19.946397 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-d8082660-0913-4649-a44e-0287f0992393 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:20:19.947151 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-d8082660-0913-4649-a44e-0287f0992393 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:20:20.102619 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-c8328805-e4ec-4d67-ac62-f02ee5cd5141 tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ba9dfbbcb5c424da17e7b198aef35d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681923b7d7b4cf682ae41fdce65a823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:20:20.117789 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-c8328805-e4ec-4d67-ac62-f02ee5cd5141 tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] 10.222.0.27 "GET /compute/v2.1/servers/749d21a5-9d48-4053-abc6-5e4f7132a5fd" status: 200 len: 1315 microversion: 2.1 time: 0.209958 Oct 17 03:20:20.118444 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 474/914] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:20:19 2022] GET /compute/v2.1/servers/749d21a5-9d48-4053-abc6-5e4f7132a5fd => generated 1315 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:20:20.122401 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-d8082660-0913-4649-a44e-0287f0992393 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82da4b8f8bdb4dbab655ff510bfa328f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc518d9b31644a8d8b21cf9c645b1373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:20:20.132360 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-d8082660-0913-4649-a44e-0287f0992393 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] 10.222.0.27 "GET /compute/v2.1/servers/96327956-efab-40b1-8b99-628ab19623be" status: 200 len: 1755 microversion: 2.1 time: 0.202944 Oct 17 03:20:20.132925 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 441/915] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:20:19 2022] GET /compute/v2.1/servers/96327956-efab-40b1-8b99-628ab19623be => generated 1755 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:20:20.248710 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-b7cebfd2-4c8f-49ba-afa7-e87b9f122062 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2129032332", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-153764123", "security_groups": [{"name": "tempest-secgroup-smoke-1985794598"}], "block_device_mapping_v2": [{"uuid": "4e61676f-4a94-4b65-9606-25314eda8a94", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "69ff13bb-8fa5-45c4-abfd-0eaaeb12e4cd"}]}} {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:20:20.360468 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.network.neutron [None req-b7cebfd2-4c8f-49ba-afa7-e87b9f122062 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] validate_networks() for [('69ff13bb-8fa5-45c4-abfd-0eaaeb12e4cd', None, None, None, None, None)] {{(pid=118886) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 03:20:20.926087 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.virt.hardware [None req-b7cebfd2-4c8f-49ba-afa7-e87b9f122062 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Flavor limits 0:0:0 {{(pid=118886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 03:20:20.926689 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.virt.hardware [None req-b7cebfd2-4c8f-49ba-afa7-e87b9f122062 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Image limits 0:0:0 {{(pid=118886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 03:20:20.927011 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.virt.hardware [None req-b7cebfd2-4c8f-49ba-afa7-e87b9f122062 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Flavor pref 0:0:0 {{(pid=118886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 03:20:20.927411 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.virt.hardware [None req-b7cebfd2-4c8f-49ba-afa7-e87b9f122062 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Image pref 0:0:0 {{(pid=118886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 03:20:20.927813 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.virt.hardware [None req-b7cebfd2-4c8f-49ba-afa7-e87b9f122062 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 03:20:20.936486 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-b7cebfd2-4c8f-49ba-afa7-e87b9f122062 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:20:20.936960 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-b7cebfd2-4c8f-49ba-afa7-e87b9f122062 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:20:20.937391 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-b7cebfd2-4c8f-49ba-afa7-e87b9f122062 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:20:20.938105 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-b7cebfd2-4c8f-49ba-afa7-e87b9f122062 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:20:20.938554 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-b7cebfd2-4c8f-49ba-afa7-e87b9f122062 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:20:20.938994 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-b7cebfd2-4c8f-49ba-afa7-e87b9f122062 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:20:20.955867 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.quota [None req-b7cebfd2-4c8f-49ba-afa7-e87b9f122062 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Getting quotas for project 917f1029c33f4607b398287532f2fb4b. Resources: {'instances', 'cores', 'ram'} {{(pid=118886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 03:20:20.959892 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.quota [None req-b7cebfd2-4c8f-49ba-afa7-e87b9f122062 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Getting quotas for user 4d30a0379df643ff81e1ca01f3e26d3d and project 917f1029c33f4607b398287532f2fb4b. Resources: {'instances', 'cores', 'ram'} {{(pid=118886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 03:20:21.016763 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-b7cebfd2-4c8f-49ba-afa7-e87b9f122062 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Going to run 1 instances... {{(pid=118886) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 03:20:21.019272 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-b7cebfd2-4c8f-49ba-afa7-e87b9f122062 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] [instance: 80dda8a9-370d-4ebe-9d60-26a482c38a14] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4e61676f-4a94-4b65-9606-25314eda8a94',volume_size=None,volume_type=None)] {{(pid=118886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 03:20:21.140575 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-456f905b-4dec-4bfe-9d87-834b67dee886 tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:20:21.141158 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-456f905b-4dec-4bfe-9d87-834b67dee886 tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] [instance: 749d21a5-9d48-4053-abc6-5e4f7132a5fd] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:20:21.147190 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-456f905b-4dec-4bfe-9d87-834b67dee886 tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:20:21.147668 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-456f905b-4dec-4bfe-9d87-834b67dee886 tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:20:21.148106 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-456f905b-4dec-4bfe-9d87-834b67dee886 tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:20:21.148245 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-b7cebfd2-4c8f-49ba-afa7-e87b9f122062 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.903211 Oct 17 03:20:21.148795 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-456f905b-4dec-4bfe-9d87-834b67dee886 tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:20:21.148910 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 475/916] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 03:20:20 2022] POST /compute/v2.1/servers => generated 406 bytes in 905 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 03:20:21.149318 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-456f905b-4dec-4bfe-9d87-834b67dee886 tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:20:21.151330 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-456f905b-4dec-4bfe-9d87-834b67dee886 tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:20:21.155904 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-3483a389-634d-40ab-993d-5e68d592ec3b tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:20:21.156596 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-3483a389-634d-40ab-993d-5e68d592ec3b tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] [instance: 96327956-efab-40b1-8b99-628ab19623be] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:20:21.163355 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-3483a389-634d-40ab-993d-5e68d592ec3b tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:20:21.168304 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-3483a389-634d-40ab-993d-5e68d592ec3b tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:20:21.168756 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-3483a389-634d-40ab-993d-5e68d592ec3b tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:20:21.169546 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-3483a389-634d-40ab-993d-5e68d592ec3b tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:20:21.169942 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-3483a389-634d-40ab-993d-5e68d592ec3b tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:20:21.170369 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-3483a389-634d-40ab-993d-5e68d592ec3b tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:20:21.307992 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-456f905b-4dec-4bfe-9d87-834b67dee886 tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ba9dfbbcb5c424da17e7b198aef35d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681923b7d7b4cf682ae41fdce65a823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:20:21.316855 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-456f905b-4dec-4bfe-9d87-834b67dee886 tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] 10.222.0.27 "GET /compute/v2.1/servers/749d21a5-9d48-4053-abc6-5e4f7132a5fd" status: 200 len: 1315 microversion: 2.1 time: 0.179694 Oct 17 03:20:21.317438 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 442/917] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:20:21 2022] GET /compute/v2.1/servers/749d21a5-9d48-4053-abc6-5e4f7132a5fd => generated 1315 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:20:21.321816 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-66215fa9-8b7f-4404-b13f-26d924598e74 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:20:21.322547 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-66215fa9-8b7f-4404-b13f-26d924598e74 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] [instance: 80dda8a9-370d-4ebe-9d60-26a482c38a14] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:20:21.359731 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-3483a389-634d-40ab-993d-5e68d592ec3b tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82da4b8f8bdb4dbab655ff510bfa328f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc518d9b31644a8d8b21cf9c645b1373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:20:21.370203 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-3483a389-634d-40ab-993d-5e68d592ec3b tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] 10.222.0.27 "GET /compute/v2.1/servers/96327956-efab-40b1-8b99-628ab19623be" status: 200 len: 1755 microversion: 2.1 time: 0.218088 Oct 17 03:20:21.370886 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 476/918] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:20:21 2022] GET /compute/v2.1/servers/96327956-efab-40b1-8b99-628ab19623be => generated 1755 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:20:21.377372 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-66215fa9-8b7f-4404-b13f-26d924598e74 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30a0379df643ff81e1ca01f3e26d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '917f1029c33f4607b398287532f2fb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:20:21.384285 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-66215fa9-8b7f-4404-b13f-26d924598e74 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] 10.222.0.27 "GET /compute/v2.1/servers/80dda8a9-370d-4ebe-9d60-26a482c38a14" status: 200 len: 1094 microversion: 2.1 time: 0.065822 Oct 17 03:20:21.384844 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 443/919] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:20:21 2022] GET /compute/v2.1/servers/80dda8a9-370d-4ebe-9d60-26a482c38a14 => generated 1094 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:20:21.993851 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [req-3c2b67c8-46d9-4398-8de3-5fcc1b75f059 req-376cd6de-86b6-46f1-b5b9-4a9c729dac7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "749d21a5-9d48-4053-abc6-5e4f7132a5fd", "name": "network-vif-plugged", "status": "completed", "tag": "060e3d64-708f-4d76-aeed-10f8c3526c37"}]} {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:20:22.007383 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [req-3c2b67c8-46d9-4398-8de3-5fcc1b75f059 req-376cd6de-86b6-46f1-b5b9-4a9c729dac7f service nova] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:20:22.007820 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [req-3c2b67c8-46d9-4398-8de3-5fcc1b75f059 req-376cd6de-86b6-46f1-b5b9-4a9c729dac7f service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:20:22.009898 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [req-3c2b67c8-46d9-4398-8de3-5fcc1b75f059 req-376cd6de-86b6-46f1-b5b9-4a9c729dac7f service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:20:22.024924 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.compute.server_external_events [req-3c2b67c8-46d9-4398-8de3-5fcc1b75f059 req-376cd6de-86b6-46f1-b5b9-4a9c729dac7f service nova] Creating event network-vif-plugged:060e3d64-708f-4d76-aeed-10f8c3526c37 for instance 749d21a5-9d48-4053-abc6-5e4f7132a5fd on hv-cinder-84697 Oct 17 03:20:22.030032 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [req-3c2b67c8-46d9-4398-8de3-5fcc1b75f059 req-376cd6de-86b6-46f1-b5b9-4a9c729dac7f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040381 Oct 17 03:20:22.030628 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 477/920] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 03:20:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:20:22.341795 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-775c896f-046d-445c-88dc-984e9008e95d tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:20:22.343219 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-775c896f-046d-445c-88dc-984e9008e95d tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] [instance: 749d21a5-9d48-4053-abc6-5e4f7132a5fd] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:20:22.350947 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-775c896f-046d-445c-88dc-984e9008e95d tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:20:22.351693 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-775c896f-046d-445c-88dc-984e9008e95d tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:20:22.352283 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-775c896f-046d-445c-88dc-984e9008e95d tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:20:22.353277 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-775c896f-046d-445c-88dc-984e9008e95d tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:20:22.353890 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-775c896f-046d-445c-88dc-984e9008e95d tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:20:22.354474 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-775c896f-046d-445c-88dc-984e9008e95d tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:20:22.394654 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-ed3b766f-6a6e-4179-9a32-212b8521e415 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:20:22.395651 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-ed3b766f-6a6e-4179-9a32-212b8521e415 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] [instance: 96327956-efab-40b1-8b99-628ab19623be] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:20:22.405300 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-ed3b766f-6a6e-4179-9a32-212b8521e415 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:20:22.406389 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-ed3b766f-6a6e-4179-9a32-212b8521e415 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:20:22.406817 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-ed3b766f-6a6e-4179-9a32-212b8521e415 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:20:22.407649 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-ed3b766f-6a6e-4179-9a32-212b8521e415 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:20:22.408148 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-ed3b766f-6a6e-4179-9a32-212b8521e415 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:20:22.408759 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-ed3b766f-6a6e-4179-9a32-212b8521e415 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:20:22.558925 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-ed3b766f-6a6e-4179-9a32-212b8521e415 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82da4b8f8bdb4dbab655ff510bfa328f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc518d9b31644a8d8b21cf9c645b1373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:20:22.567853 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-ed3b766f-6a6e-4179-9a32-212b8521e415 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] 10.222.0.27 "GET /compute/v2.1/servers/96327956-efab-40b1-8b99-628ab19623be" status: 200 len: 1755 microversion: 2.1 time: 0.177789 Oct 17 03:20:22.568423 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 478/921] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:20:22 2022] GET /compute/v2.1/servers/96327956-efab-40b1-8b99-628ab19623be => generated 1755 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:20:22.573039 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-17933442-334a-496c-9a6f-21efe845ff38 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:20:22.573641 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-17933442-334a-496c-9a6f-21efe845ff38 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] [instance: 80dda8a9-370d-4ebe-9d60-26a482c38a14] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:20:22.579982 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-17933442-334a-496c-9a6f-21efe845ff38 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:20:22.580760 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-17933442-334a-496c-9a6f-21efe845ff38 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:20:22.581668 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-17933442-334a-496c-9a6f-21efe845ff38 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:20:22.582645 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-17933442-334a-496c-9a6f-21efe845ff38 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:20:22.583602 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-17933442-334a-496c-9a6f-21efe845ff38 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:20:22.584044 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-17933442-334a-496c-9a6f-21efe845ff38 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:20:22.613557 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-775c896f-046d-445c-88dc-984e9008e95d tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ba9dfbbcb5c424da17e7b198aef35d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681923b7d7b4cf682ae41fdce65a823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:20:22.633128 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-775c896f-046d-445c-88dc-984e9008e95d tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] 10.222.0.27 "GET /compute/v2.1/servers/749d21a5-9d48-4053-abc6-5e4f7132a5fd" status: 200 len: 1315 microversion: 2.1 time: 0.296199 Oct 17 03:20:22.642702 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 444/922] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:20:22 2022] GET /compute/v2.1/servers/749d21a5-9d48-4053-abc6-5e4f7132a5fd => generated 1315 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:20:22.649226 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-17933442-334a-496c-9a6f-21efe845ff38 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30a0379df643ff81e1ca01f3e26d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '917f1029c33f4607b398287532f2fb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:20:22.656964 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-17933442-334a-496c-9a6f-21efe845ff38 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] 10.222.0.27 "GET /compute/v2.1/servers/80dda8a9-370d-4ebe-9d60-26a482c38a14" status: 200 len: 1210 microversion: 2.1 time: 0.087502 Oct 17 03:20:22.657519 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 479/923] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:20:22 2022] GET /compute/v2.1/servers/80dda8a9-370d-4ebe-9d60-26a482c38a14 => generated 1210 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:20:23.590568 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-6bad1927-05c0-412a-b1ea-8bd5f3ae7e31 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:20:23.591292 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-6bad1927-05c0-412a-b1ea-8bd5f3ae7e31 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] [instance: 96327956-efab-40b1-8b99-628ab19623be] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:20:23.597985 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-6bad1927-05c0-412a-b1ea-8bd5f3ae7e31 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:20:23.598913 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-6bad1927-05c0-412a-b1ea-8bd5f3ae7e31 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:20:23.599572 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-6bad1927-05c0-412a-b1ea-8bd5f3ae7e31 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:20:23.600477 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-6bad1927-05c0-412a-b1ea-8bd5f3ae7e31 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:20:23.601243 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-6bad1927-05c0-412a-b1ea-8bd5f3ae7e31 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:20:23.601805 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-6bad1927-05c0-412a-b1ea-8bd5f3ae7e31 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:20:23.657012 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-76b5becc-cee6-4174-ac29-18fb5ed1ab4a tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:20:23.657765 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-76b5becc-cee6-4174-ac29-18fb5ed1ab4a tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] [instance: 749d21a5-9d48-4053-abc6-5e4f7132a5fd] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:20:23.664941 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-76b5becc-cee6-4174-ac29-18fb5ed1ab4a tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:20:23.665495 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-76b5becc-cee6-4174-ac29-18fb5ed1ab4a tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:20:23.666007 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-76b5becc-cee6-4174-ac29-18fb5ed1ab4a tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:20:23.666700 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-76b5becc-cee6-4174-ac29-18fb5ed1ab4a tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:20:23.667172 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-76b5becc-cee6-4174-ac29-18fb5ed1ab4a tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:20:23.667596 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-76b5becc-cee6-4174-ac29-18fb5ed1ab4a tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:20:23.799838 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-76b5becc-cee6-4174-ac29-18fb5ed1ab4a tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ba9dfbbcb5c424da17e7b198aef35d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681923b7d7b4cf682ae41fdce65a823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:20:23.808317 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-76b5becc-cee6-4174-ac29-18fb5ed1ab4a tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] 10.222.0.27 "GET /compute/v2.1/servers/749d21a5-9d48-4053-abc6-5e4f7132a5fd" status: 200 len: 1315 microversion: 2.1 time: 0.155130 Oct 17 03:20:23.808869 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 480/924] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:20:23 2022] GET /compute/v2.1/servers/749d21a5-9d48-4053-abc6-5e4f7132a5fd => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:20:23.813279 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-6a77d03f-db92-4d14-aefe-0ff1d93c85fd tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:20:23.813891 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-6a77d03f-db92-4d14-aefe-0ff1d93c85fd tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] [instance: 80dda8a9-370d-4ebe-9d60-26a482c38a14] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:20:23.820836 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-6a77d03f-db92-4d14-aefe-0ff1d93c85fd tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:20:23.821787 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-6a77d03f-db92-4d14-aefe-0ff1d93c85fd tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:20:23.822352 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-6a77d03f-db92-4d14-aefe-0ff1d93c85fd tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:20:23.823184 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-6a77d03f-db92-4d14-aefe-0ff1d93c85fd tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:20:23.823830 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-6a77d03f-db92-4d14-aefe-0ff1d93c85fd tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:20:23.824468 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-6a77d03f-db92-4d14-aefe-0ff1d93c85fd tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:20:23.858061 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-6bad1927-05c0-412a-b1ea-8bd5f3ae7e31 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82da4b8f8bdb4dbab655ff510bfa328f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc518d9b31644a8d8b21cf9c645b1373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:20:23.866524 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-6bad1927-05c0-412a-b1ea-8bd5f3ae7e31 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] 10.222.0.27 "GET /compute/v2.1/servers/96327956-efab-40b1-8b99-628ab19623be" status: 200 len: 1755 microversion: 2.1 time: 0.279801 Oct 17 03:20:23.867351 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 445/925] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:20:23 2022] GET /compute/v2.1/servers/96327956-efab-40b1-8b99-628ab19623be => generated 1755 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:20:23.961050 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-6a77d03f-db92-4d14-aefe-0ff1d93c85fd tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30a0379df643ff81e1ca01f3e26d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '917f1029c33f4607b398287532f2fb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:20:23.969320 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-6a77d03f-db92-4d14-aefe-0ff1d93c85fd tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] 10.222.0.27 "GET /compute/v2.1/servers/80dda8a9-370d-4ebe-9d60-26a482c38a14" status: 200 len: 1266 microversion: 2.1 time: 0.159428 Oct 17 03:20:23.970091 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 481/926] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:20:23 2022] GET /compute/v2.1/servers/80dda8a9-370d-4ebe-9d60-26a482c38a14 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:20:24.195647 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [req-a376b2ea-ff58-411e-8b84-b37a7609564b req-6eb97e37-0e45-4641-983b-4c7cc782867c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80dda8a9-370d-4ebe-9d60-26a482c38a14", "tag": "eae0ee63-abc6-4231-af35-475536e08de6"}]} {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:20:24.205537 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [req-a376b2ea-ff58-411e-8b84-b37a7609564b req-6eb97e37-0e45-4641-983b-4c7cc782867c service nova] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:20:24.206011 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [req-a376b2ea-ff58-411e-8b84-b37a7609564b req-6eb97e37-0e45-4641-983b-4c7cc782867c service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:20:24.206425 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [req-a376b2ea-ff58-411e-8b84-b37a7609564b req-6eb97e37-0e45-4641-983b-4c7cc782867c service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:20:24.224238 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.compute.server_external_events [req-a376b2ea-ff58-411e-8b84-b37a7609564b req-6eb97e37-0e45-4641-983b-4c7cc782867c service nova] Creating event network-changed:eae0ee63-abc6-4231-af35-475536e08de6 for instance 80dda8a9-370d-4ebe-9d60-26a482c38a14 on hv-cinder-84697 Oct 17 03:20:24.229867 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [req-a376b2ea-ff58-411e-8b84-b37a7609564b req-6eb97e37-0e45-4641-983b-4c7cc782867c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038504 Oct 17 03:20:24.230674 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 446/927] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 03:20:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:20:24.832297 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-911b7e68-4be1-4f43-9a69-a168d8961694 tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:20:24.832960 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-911b7e68-4be1-4f43-9a69-a168d8961694 tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] [instance: 749d21a5-9d48-4053-abc6-5e4f7132a5fd] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:20:24.839509 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-911b7e68-4be1-4f43-9a69-a168d8961694 tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:20:24.839990 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-911b7e68-4be1-4f43-9a69-a168d8961694 tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:20:24.840418 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-911b7e68-4be1-4f43-9a69-a168d8961694 tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:20:24.841114 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-911b7e68-4be1-4f43-9a69-a168d8961694 tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:20:24.841560 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-911b7e68-4be1-4f43-9a69-a168d8961694 tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:20:24.841977 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-911b7e68-4be1-4f43-9a69-a168d8961694 tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:20:24.862454 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG dbcounter [-] [118886] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:20:24.891642 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-70f183e4-820f-481f-af6f-da4efb0e7fff tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:20:24.892435 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-70f183e4-820f-481f-af6f-da4efb0e7fff tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] [instance: 96327956-efab-40b1-8b99-628ab19623be] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:20:24.899045 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-70f183e4-820f-481f-af6f-da4efb0e7fff tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:20:24.899644 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-70f183e4-820f-481f-af6f-da4efb0e7fff tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:20:24.900148 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-70f183e4-820f-481f-af6f-da4efb0e7fff tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:20:24.900919 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-70f183e4-820f-481f-af6f-da4efb0e7fff tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:20:24.901446 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-70f183e4-820f-481f-af6f-da4efb0e7fff tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:20:24.901944 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-70f183e4-820f-481f-af6f-da4efb0e7fff tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:20:24.986216 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-911b7e68-4be1-4f43-9a69-a168d8961694 tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ba9dfbbcb5c424da17e7b198aef35d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681923b7d7b4cf682ae41fdce65a823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:20:24.994817 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-911b7e68-4be1-4f43-9a69-a168d8961694 tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] 10.222.0.27 "GET /compute/v2.1/servers/749d21a5-9d48-4053-abc6-5e4f7132a5fd" status: 200 len: 1465 microversion: 2.1 time: 0.166299 Oct 17 03:20:24.995510 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 482/928] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:20:24 2022] GET /compute/v2.1/servers/749d21a5-9d48-4053-abc6-5e4f7132a5fd => generated 1465 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:20:25.000363 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-fab2e3d0-17e0-4cce-837e-3838f37bc489 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:20:25.001156 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-fab2e3d0-17e0-4cce-837e-3838f37bc489 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] [instance: 80dda8a9-370d-4ebe-9d60-26a482c38a14] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:20:25.007171 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-fab2e3d0-17e0-4cce-837e-3838f37bc489 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:20:25.007743 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-fab2e3d0-17e0-4cce-837e-3838f37bc489 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:20:25.008333 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-fab2e3d0-17e0-4cce-837e-3838f37bc489 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:20:25.009083 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-fab2e3d0-17e0-4cce-837e-3838f37bc489 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:20:25.009601 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-fab2e3d0-17e0-4cce-837e-3838f37bc489 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:20:25.010216 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-fab2e3d0-17e0-4cce-837e-3838f37bc489 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:20:25.146416 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-70f183e4-820f-481f-af6f-da4efb0e7fff tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82da4b8f8bdb4dbab655ff510bfa328f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc518d9b31644a8d8b21cf9c645b1373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:20:25.151773 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-fab2e3d0-17e0-4cce-837e-3838f37bc489 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30a0379df643ff81e1ca01f3e26d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '917f1029c33f4607b398287532f2fb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:20:25.155643 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-70f183e4-820f-481f-af6f-da4efb0e7fff tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] 10.222.0.27 "GET /compute/v2.1/servers/96327956-efab-40b1-8b99-628ab19623be" status: 200 len: 1755 microversion: 2.1 time: 0.268124 Oct 17 03:20:25.156304 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 447/929] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:20:24 2022] GET /compute/v2.1/servers/96327956-efab-40b1-8b99-628ab19623be => generated 1755 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:20:25.173099 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-fab2e3d0-17e0-4cce-837e-3838f37bc489 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] 10.222.0.27 "GET /compute/v2.1/servers/80dda8a9-370d-4ebe-9d60-26a482c38a14" status: 200 len: 1266 microversion: 2.1 time: 0.176373 Oct 17 03:20:25.173312 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-afacf44f-dfb3-4cfd-9f42-68b6c30d80f7 tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:20:25.173850 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-afacf44f-dfb3-4cfd-9f42-68b6c30d80f7 tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] [instance: 749d21a5-9d48-4053-abc6-5e4f7132a5fd] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:20:25.174477 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 483/930] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:20:24 2022] GET /compute/v2.1/servers/80dda8a9-370d-4ebe-9d60-26a482c38a14 => generated 1266 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:20:25.181666 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-afacf44f-dfb3-4cfd-9f42-68b6c30d80f7 tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:20:25.182198 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-afacf44f-dfb3-4cfd-9f42-68b6c30d80f7 tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:20:25.182661 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-afacf44f-dfb3-4cfd-9f42-68b6c30d80f7 tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:20:25.183547 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-afacf44f-dfb3-4cfd-9f42-68b6c30d80f7 tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:20:25.183874 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-afacf44f-dfb3-4cfd-9f42-68b6c30d80f7 tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:20:25.184299 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-afacf44f-dfb3-4cfd-9f42-68b6c30d80f7 tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:20:25.210400 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-afacf44f-dfb3-4cfd-9f42-68b6c30d80f7 tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] [instance: 749d21a5-9d48-4053-abc6-5e4f7132a5fd] Going to try to terminate instance {{(pid=118887) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 03:20:25.289908 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-afacf44f-dfb3-4cfd-9f42-68b6c30d80f7 tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] 10.222.0.27 "DELETE /compute/v2.1/servers/749d21a5-9d48-4053-abc6-5e4f7132a5fd" status: 204 len: 0 microversion: 2.1 time: 0.131944 Oct 17 03:20:25.290496 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 448/931] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 03:20:25 2022] DELETE /compute/v2.1/servers/749d21a5-9d48-4053-abc6-5e4f7132a5fd => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 03:20:25.300406 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-fd38dd2c-266c-4a2d-8c19-c57a47f29fd5 tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:20:25.301357 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-fd38dd2c-266c-4a2d-8c19-c57a47f29fd5 tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] [instance: 749d21a5-9d48-4053-abc6-5e4f7132a5fd] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:20:25.307476 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-fd38dd2c-266c-4a2d-8c19-c57a47f29fd5 tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:20:25.308029 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-fd38dd2c-266c-4a2d-8c19-c57a47f29fd5 tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:20:25.308528 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-fd38dd2c-266c-4a2d-8c19-c57a47f29fd5 tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:20:25.309293 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-fd38dd2c-266c-4a2d-8c19-c57a47f29fd5 tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:20:25.309743 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-fd38dd2c-266c-4a2d-8c19-c57a47f29fd5 tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:20:25.310182 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-fd38dd2c-266c-4a2d-8c19-c57a47f29fd5 tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:20:25.439131 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-fd38dd2c-266c-4a2d-8c19-c57a47f29fd5 tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ba9dfbbcb5c424da17e7b198aef35d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681923b7d7b4cf682ae41fdce65a823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:20:25.447089 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-fd38dd2c-266c-4a2d-8c19-c57a47f29fd5 tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] 10.222.0.27 "GET /compute/v2.1/servers/749d21a5-9d48-4053-abc6-5e4f7132a5fd" status: 200 len: 1471 microversion: 2.1 time: 0.152018 Oct 17 03:20:25.447656 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 484/932] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:20:25 2022] GET /compute/v2.1/servers/749d21a5-9d48-4053-abc6-5e4f7132a5fd => generated 1471 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:20:26.181014 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-58dbd4fb-0593-45f2-9bcf-061d415a661e tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:20:26.181704 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-58dbd4fb-0593-45f2-9bcf-061d415a661e tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] [instance: 96327956-efab-40b1-8b99-628ab19623be] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:20:26.188048 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-58dbd4fb-0593-45f2-9bcf-061d415a661e tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:20:26.188528 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-58dbd4fb-0593-45f2-9bcf-061d415a661e tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:20:26.188958 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-58dbd4fb-0593-45f2-9bcf-061d415a661e tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:20:26.189677 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-58dbd4fb-0593-45f2-9bcf-061d415a661e tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:20:26.190124 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-58dbd4fb-0593-45f2-9bcf-061d415a661e tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:20:26.190545 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-58dbd4fb-0593-45f2-9bcf-061d415a661e tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:20:26.198999 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-1b387486-708a-4b1d-9154-563d7fa1fe73 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:20:26.199609 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-1b387486-708a-4b1d-9154-563d7fa1fe73 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] [instance: 80dda8a9-370d-4ebe-9d60-26a482c38a14] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:20:26.206158 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-1b387486-708a-4b1d-9154-563d7fa1fe73 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:20:26.206623 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-1b387486-708a-4b1d-9154-563d7fa1fe73 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:20:26.207077 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-1b387486-708a-4b1d-9154-563d7fa1fe73 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:20:26.207918 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-1b387486-708a-4b1d-9154-563d7fa1fe73 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:20:26.208376 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-1b387486-708a-4b1d-9154-563d7fa1fe73 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:20:26.208794 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-1b387486-708a-4b1d-9154-563d7fa1fe73 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:20:26.342314 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-58dbd4fb-0593-45f2-9bcf-061d415a661e tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82da4b8f8bdb4dbab655ff510bfa328f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc518d9b31644a8d8b21cf9c645b1373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:20:26.343972 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-1b387486-708a-4b1d-9154-563d7fa1fe73 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30a0379df643ff81e1ca01f3e26d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '917f1029c33f4607b398287532f2fb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:20:26.351383 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-58dbd4fb-0593-45f2-9bcf-061d415a661e tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] 10.222.0.27 "GET /compute/v2.1/servers/96327956-efab-40b1-8b99-628ab19623be" status: 200 len: 1755 microversion: 2.1 time: 0.175243 Oct 17 03:20:26.352056 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 449/933] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:20:26 2022] GET /compute/v2.1/servers/96327956-efab-40b1-8b99-628ab19623be => generated 1755 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:20:26.352271 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-1b387486-708a-4b1d-9154-563d7fa1fe73 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] 10.222.0.27 "GET /compute/v2.1/servers/80dda8a9-370d-4ebe-9d60-26a482c38a14" status: 200 len: 1266 microversion: 2.1 time: 0.160029 Oct 17 03:20:26.353029 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 485/934] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:20:26 2022] GET /compute/v2.1/servers/80dda8a9-370d-4ebe-9d60-26a482c38a14 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:20:26.471337 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-fe7a1f1e-3712-429d-bb44-d701ab02a8d1 tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:20:26.471859 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-fe7a1f1e-3712-429d-bb44-d701ab02a8d1 tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] [instance: 749d21a5-9d48-4053-abc6-5e4f7132a5fd] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:20:26.478315 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-fe7a1f1e-3712-429d-bb44-d701ab02a8d1 tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:20:26.478802 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-fe7a1f1e-3712-429d-bb44-d701ab02a8d1 tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:20:26.479270 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-fe7a1f1e-3712-429d-bb44-d701ab02a8d1 tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:20:26.479993 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-fe7a1f1e-3712-429d-bb44-d701ab02a8d1 tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:20:26.480452 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-fe7a1f1e-3712-429d-bb44-d701ab02a8d1 tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:20:26.480874 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-fe7a1f1e-3712-429d-bb44-d701ab02a8d1 tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:20:26.611423 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-fe7a1f1e-3712-429d-bb44-d701ab02a8d1 tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ba9dfbbcb5c424da17e7b198aef35d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681923b7d7b4cf682ae41fdce65a823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:20:26.619690 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-fe7a1f1e-3712-429d-bb44-d701ab02a8d1 tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] 10.222.0.27 "GET /compute/v2.1/servers/749d21a5-9d48-4053-abc6-5e4f7132a5fd" status: 200 len: 1471 microversion: 2.1 time: 0.152265 Oct 17 03:20:26.620264 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 450/935] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:20:26 2022] GET /compute/v2.1/servers/749d21a5-9d48-4053-abc6-5e4f7132a5fd => generated 1471 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:20:27.190648 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [req-91c14b10-f0d8-440e-bc45-eb8f7cbd4398 req-469f33fb-47b4-4c5a-9da2-85d544e9e0a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "749d21a5-9d48-4053-abc6-5e4f7132a5fd", "name": "network-vif-deleted", "tag": "060e3d64-708f-4d76-aeed-10f8c3526c37"}]} {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:20:27.205044 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [req-91c14b10-f0d8-440e-bc45-eb8f7cbd4398 req-469f33fb-47b4-4c5a-9da2-85d544e9e0a1 service nova] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:20:27.205044 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [req-91c14b10-f0d8-440e-bc45-eb8f7cbd4398 req-469f33fb-47b4-4c5a-9da2-85d544e9e0a1 service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:20:27.207334 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [req-91c14b10-f0d8-440e-bc45-eb8f7cbd4398 req-469f33fb-47b4-4c5a-9da2-85d544e9e0a1 service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:20:27.227634 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.compute.server_external_events [req-91c14b10-f0d8-440e-bc45-eb8f7cbd4398 req-469f33fb-47b4-4c5a-9da2-85d544e9e0a1 service nova] Creating event network-vif-deleted:060e3d64-708f-4d76-aeed-10f8c3526c37 for instance 749d21a5-9d48-4053-abc6-5e4f7132a5fd on hv-cinder-84697 Oct 17 03:20:27.237001 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [req-91c14b10-f0d8-440e-bc45-eb8f7cbd4398 req-469f33fb-47b4-4c5a-9da2-85d544e9e0a1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048789 Oct 17 03:20:27.237630 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 486/936] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 03:20:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:20:27.375323 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-764752bd-1588-4570-9e4d-fa093b520f04 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:20:27.375870 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-764752bd-1588-4570-9e4d-fa093b520f04 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] [instance: 96327956-efab-40b1-8b99-628ab19623be] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:20:27.376308 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-a9ab82af-d35e-458f-86e0-a862a0c5a434 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:20:27.377218 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-a9ab82af-d35e-458f-86e0-a862a0c5a434 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] [instance: 80dda8a9-370d-4ebe-9d60-26a482c38a14] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:20:27.383779 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-764752bd-1588-4570-9e4d-fa093b520f04 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:20:27.384208 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-a9ab82af-d35e-458f-86e0-a862a0c5a434 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:20:27.384330 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-764752bd-1588-4570-9e4d-fa093b520f04 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:20:27.384693 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-a9ab82af-d35e-458f-86e0-a862a0c5a434 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:20:27.384808 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-764752bd-1588-4570-9e4d-fa093b520f04 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:20:27.385126 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-a9ab82af-d35e-458f-86e0-a862a0c5a434 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:20:27.385837 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-a9ab82af-d35e-458f-86e0-a862a0c5a434 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:20:27.386556 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-a9ab82af-d35e-458f-86e0-a862a0c5a434 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:20:27.386799 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-764752bd-1588-4570-9e4d-fa093b520f04 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:20:27.387035 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-a9ab82af-d35e-458f-86e0-a862a0c5a434 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:20:27.387284 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-764752bd-1588-4570-9e4d-fa093b520f04 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:20:27.387711 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-764752bd-1588-4570-9e4d-fa093b520f04 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:20:27.396361 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG dbcounter [-] [118887] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:20:27.539972 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-a9ab82af-d35e-458f-86e0-a862a0c5a434 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30a0379df643ff81e1ca01f3e26d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '917f1029c33f4607b398287532f2fb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:20:27.555560 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-764752bd-1588-4570-9e4d-fa093b520f04 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82da4b8f8bdb4dbab655ff510bfa328f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc518d9b31644a8d8b21cf9c645b1373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:20:27.555902 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-a9ab82af-d35e-458f-86e0-a862a0c5a434 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] 10.222.0.27 "GET /compute/v2.1/servers/80dda8a9-370d-4ebe-9d60-26a482c38a14" status: 200 len: 1266 microversion: 2.1 time: 0.183820 Oct 17 03:20:27.556500 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 487/937] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:20:27 2022] GET /compute/v2.1/servers/80dda8a9-370d-4ebe-9d60-26a482c38a14 => generated 1266 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:20:27.564870 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-764752bd-1588-4570-9e4d-fa093b520f04 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] 10.222.0.27 "GET /compute/v2.1/servers/96327956-efab-40b1-8b99-628ab19623be" status: 200 len: 1755 microversion: 2.1 time: 0.193778 Oct 17 03:20:27.565447 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 451/938] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:20:27 2022] GET /compute/v2.1/servers/96327956-efab-40b1-8b99-628ab19623be => generated 1755 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:20:27.641606 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-7c7ed471-6ee1-4fd7-bd0c-9a2a9ec938d3 tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:20:27.642134 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-7c7ed471-6ee1-4fd7-bd0c-9a2a9ec938d3 tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] [instance: 749d21a5-9d48-4053-abc6-5e4f7132a5fd] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:20:27.648439 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-7c7ed471-6ee1-4fd7-bd0c-9a2a9ec938d3 tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:20:27.648929 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-7c7ed471-6ee1-4fd7-bd0c-9a2a9ec938d3 tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:20:27.649403 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-7c7ed471-6ee1-4fd7-bd0c-9a2a9ec938d3 tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:20:27.650121 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-7c7ed471-6ee1-4fd7-bd0c-9a2a9ec938d3 tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:20:27.650570 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-7c7ed471-6ee1-4fd7-bd0c-9a2a9ec938d3 tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:20:27.651025 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-7c7ed471-6ee1-4fd7-bd0c-9a2a9ec938d3 tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:20:27.683504 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-7c7ed471-6ee1-4fd7-bd0c-9a2a9ec938d3 tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:20:27.683995 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-7c7ed471-6ee1-4fd7-bd0c-9a2a9ec938d3 tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:20:27.684431 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-7c7ed471-6ee1-4fd7-bd0c-9a2a9ec938d3 tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:20:27.685022 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.objects.instance [None req-7c7ed471-6ee1-4fd7-bd0c-9a2a9ec938d3 tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] Lazy-loading 'fault' on Instance uuid 749d21a5-9d48-4053-abc6-5e4f7132a5fd {{(pid=118886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 03:20:27.729184 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-7c7ed471-6ee1-4fd7-bd0c-9a2a9ec938d3 tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ba9dfbbcb5c424da17e7b198aef35d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681923b7d7b4cf682ae41fdce65a823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:20:27.737081 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-7c7ed471-6ee1-4fd7-bd0c-9a2a9ec938d3 tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] 10.222.0.27 "GET /compute/v2.1/servers/749d21a5-9d48-4053-abc6-5e4f7132a5fd" status: 200 len: 1305 microversion: 2.1 time: 0.099415 Oct 17 03:20:27.737654 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 488/939] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:20:27 2022] GET /compute/v2.1/servers/749d21a5-9d48-4053-abc6-5e4f7132a5fd => generated 1305 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:20:28.578908 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-ce391ffc-60a1-44b2-ae99-7f0872327ac4 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:20:28.579521 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-ce391ffc-60a1-44b2-ae99-7f0872327ac4 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] [instance: 80dda8a9-370d-4ebe-9d60-26a482c38a14] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:20:28.587481 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-ce391ffc-60a1-44b2-ae99-7f0872327ac4 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:20:28.588042 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-ce391ffc-60a1-44b2-ae99-7f0872327ac4 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:20:28.588482 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-ce391ffc-60a1-44b2-ae99-7f0872327ac4 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:20:28.588803 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-6543b1c0-f168-48b7-9d5c-137614001219 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:20:28.589224 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-ce391ffc-60a1-44b2-ae99-7f0872327ac4 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:20:28.589412 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-6543b1c0-f168-48b7-9d5c-137614001219 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] [instance: 96327956-efab-40b1-8b99-628ab19623be] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:20:28.589660 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-ce391ffc-60a1-44b2-ae99-7f0872327ac4 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:20:28.590089 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-ce391ffc-60a1-44b2-ae99-7f0872327ac4 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:20:28.595951 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-6543b1c0-f168-48b7-9d5c-137614001219 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:20:28.596427 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-6543b1c0-f168-48b7-9d5c-137614001219 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:20:28.596863 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-6543b1c0-f168-48b7-9d5c-137614001219 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:20:28.597552 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-6543b1c0-f168-48b7-9d5c-137614001219 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:20:28.598002 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-6543b1c0-f168-48b7-9d5c-137614001219 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:20:28.598798 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-6543b1c0-f168-48b7-9d5c-137614001219 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:20:28.724067 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-ce391ffc-60a1-44b2-ae99-7f0872327ac4 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30a0379df643ff81e1ca01f3e26d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '917f1029c33f4607b398287532f2fb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:20:28.731742 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-ce391ffc-60a1-44b2-ae99-7f0872327ac4 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] 10.222.0.27 "GET /compute/v2.1/servers/80dda8a9-370d-4ebe-9d60-26a482c38a14" status: 200 len: 1266 microversion: 2.1 time: 0.156682 Oct 17 03:20:28.732531 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 452/940] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:20:28 2022] GET /compute/v2.1/servers/80dda8a9-370d-4ebe-9d60-26a482c38a14 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:20:28.744725 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-6543b1c0-f168-48b7-9d5c-137614001219 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82da4b8f8bdb4dbab655ff510bfa328f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc518d9b31644a8d8b21cf9c645b1373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:20:28.752788 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-6543b1c0-f168-48b7-9d5c-137614001219 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] 10.222.0.27 "GET /compute/v2.1/servers/96327956-efab-40b1-8b99-628ab19623be" status: 200 len: 1758 microversion: 2.1 time: 0.167813 Oct 17 03:20:28.753345 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 489/941] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:20:28 2022] GET /compute/v2.1/servers/96327956-efab-40b1-8b99-628ab19623be => generated 1758 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:20:28.760277 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-547e4413-a1b8-4727-8b0a-ba1b60e13052 tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:20:28.760885 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-547e4413-a1b8-4727-8b0a-ba1b60e13052 tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] [instance: 749d21a5-9d48-4053-abc6-5e4f7132a5fd] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:20:28.766839 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-547e4413-a1b8-4727-8b0a-ba1b60e13052 tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:20:28.767353 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-547e4413-a1b8-4727-8b0a-ba1b60e13052 tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:20:28.767781 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-547e4413-a1b8-4727-8b0a-ba1b60e13052 tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:20:28.768469 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-547e4413-a1b8-4727-8b0a-ba1b60e13052 tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:20:28.768918 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-547e4413-a1b8-4727-8b0a-ba1b60e13052 tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:20:28.769344 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-547e4413-a1b8-4727-8b0a-ba1b60e13052 tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:20:28.782969 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.wsgi [None req-547e4413-a1b8-4727-8b0a-ba1b60e13052 tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] HTTP exception thrown: Instance 749d21a5-9d48-4053-abc6-5e4f7132a5fd could not be found. Oct 17 03:20:28.784586 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-547e4413-a1b8-4727-8b0a-ba1b60e13052 tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] Request method failure captured: Oct 17 03:20:28.784586 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: request: GET /compute/v2.1/servers/749d21a5-9d48-4053-abc6-5e4f7132a5fd HTTP/1.1 Oct 17 03:20:28.784586 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Accept: application/json Oct 17 03:20:28.784586 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Accept-Encoding: identity Oct 17 03:20:28.784586 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Connection: close Oct 17 03:20:28.784586 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Content-Length: 0 Oct 17 03:20:28.784586 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Content-Type: application/json Oct 17 03:20:28.784586 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Host: 10.222.0.27 Oct 17 03:20:28.784586 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Openstack-System-Scope: None Oct 17 03:20:28.784586 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: User-Agent: python-urllib3/1.26.12 Oct 17 03:20:28.784586 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Auth-Token: gAAAAABjTMnl-8kdMoGPuV2oRBvrrfyWW9AyemGYXsGoklucdg9kBLiA8bygTWZ_ERmAec-2HrlmKOYY6pjEwE23mj3Xpb14ynQlsLu4VlrMF95Otq578Zl2rgvuPgISDtX_fhdUx-rQPJcQU0iZaqDyx6Jd1M9Bp5JauqW85ElQ7mliZ-94XIs Oct 17 03:20:28.784586 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Domain-Id: None Oct 17 03:20:28.784586 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Domain-Name: None Oct 17 03:20:28.784586 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Identity-Status: Confirmed Oct 17 03:20:28.784586 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Is-Admin-Project: True Oct 17 03:20:28.784586 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Project-Domain-Id: default Oct 17 03:20:28.784586 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Project-Domain-Name: Default Oct 17 03:20:28.784586 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Project-Id: b681923b7d7b4cf682ae41fdce65a823 Oct 17 03:20:28.784586 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Project-Name: tempest-VolumesNegativeTest-1939302418 Oct 17 03:20:28.784586 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Role: member,reader Oct 17 03:20:28.784586 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Roles: member,reader Oct 17 03:20:28.786723 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b681923b7d7b4cf682ae41fdce65a823"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b681923b7d7b4cf682ae41fdce65a823"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b681923b7d7b4cf682ae41fdce65a823"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b681923b7d7b4cf682ae41fdce65a823"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 17 03:20:28.786723 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Tenant: tempest-VolumesNegativeTest-1939302418 Oct 17 03:20:28.786723 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Tenant-Id: b681923b7d7b4cf682ae41fdce65a823 Oct 17 03:20:28.786723 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Tenant-Name: tempest-VolumesNegativeTest-1939302418 Oct 17 03:20:28.786723 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-User: tempest-VolumesNegativeTest-1939302418-project Oct 17 03:20:28.786723 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-User-Domain-Id: default Oct 17 03:20:28.786723 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-User-Domain-Name: Default Oct 17 03:20:28.786723 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-User-Id: 1ba9dfbbcb5c424da17e7b198aef35d9 Oct 17 03:20:28.786723 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-User-Name: tempest-VolumesNegativeTest-1939302418-project Oct 17 03:20:28.786723 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: method: > Oct 17 03:20:28.786723 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: exception: Instance 749d21a5-9d48-4053-abc6-5e4f7132a5fd could not be found. Oct 17 03:20:28.786723 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: action_args: {'id': '749d21a5-9d48-4053-abc6-5e4f7132a5fd'} Oct 17 03:20:28.787691 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 03:20:28.787691 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:20:28.787691 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 03:20:28.787691 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 03:20:28.787691 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 03:20:28.787691 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 03:20:28.787691 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 03:20:28.787691 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 03:20:28.787691 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 03:20:28.787691 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 03:20:28.787691 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 749d21a5-9d48-4053-abc6-5e4f7132a5fd could not be found. Oct 17 03:20:28.787691 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Oct 17 03:20:28.787691 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:20:28.787691 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Oct 17 03:20:28.787691 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:20:28.787691 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:20:28.787691 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:20:28.787691 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 03:20:28.787691 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 03:20:28.787691 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 03:20:28.789311 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 03:20:28.789311 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 03:20:28.789311 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 03:20:28.789311 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 03:20:28.789311 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 03:20:28.789311 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 03:20:28.789311 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 03:20:28.789311 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 749d21a5-9d48-4053-abc6-5e4f7132a5fd could not be found. Oct 17 03:20:28.789311 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Oct 17 03:20:28.789311 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:20:28.789311 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Oct 17 03:20:28.789311 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:20:28.789311 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:20:28.789311 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:20:28.789311 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 03:20:28.789311 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 03:20:28.789311 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 749d21a5-9d48-4053-abc6-5e4f7132a5fd could not be found. Oct 17 03:20:28.789311 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Oct 17 03:20:28.790578 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-547e4413-a1b8-4727-8b0a-ba1b60e13052 tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] Returning 404 to user: Instance 749d21a5-9d48-4053-abc6-5e4f7132a5fd could not be found. {{(pid=118887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 03:20:28.790578 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-547e4413-a1b8-4727-8b0a-ba1b60e13052 tempest-VolumesNegativeTest-1939302418 tempest-VolumesNegativeTest-1939302418-project] 10.222.0.27 "GET /compute/v2.1/servers/749d21a5-9d48-4053-abc6-5e4f7132a5fd" status: 404 len: 111 microversion: 2.1 time: 0.029421 Oct 17 03:20:28.790578 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 453/942] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:20:28 2022] GET /compute/v2.1/servers/749d21a5-9d48-4053-abc6-5e4f7132a5fd => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 03:20:29.753345 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-ef0cdaa3-eb7b-46e5-9202-b950fdb1d542 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:20:29.753948 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-ef0cdaa3-eb7b-46e5-9202-b950fdb1d542 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] [instance: 80dda8a9-370d-4ebe-9d60-26a482c38a14] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:20:29.760630 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-ef0cdaa3-eb7b-46e5-9202-b950fdb1d542 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:20:29.761107 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-ef0cdaa3-eb7b-46e5-9202-b950fdb1d542 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:20:29.761537 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-ef0cdaa3-eb7b-46e5-9202-b950fdb1d542 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:20:29.762228 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-ef0cdaa3-eb7b-46e5-9202-b950fdb1d542 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:20:29.762662 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-ef0cdaa3-eb7b-46e5-9202-b950fdb1d542 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:20:29.763107 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-ef0cdaa3-eb7b-46e5-9202-b950fdb1d542 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:20:29.902057 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-ef0cdaa3-eb7b-46e5-9202-b950fdb1d542 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30a0379df643ff81e1ca01f3e26d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '917f1029c33f4607b398287532f2fb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:20:29.910410 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-ef0cdaa3-eb7b-46e5-9202-b950fdb1d542 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] 10.222.0.27 "GET /compute/v2.1/servers/80dda8a9-370d-4ebe-9d60-26a482c38a14" status: 200 len: 1266 microversion: 2.1 time: 0.160677 Oct 17 03:20:29.911933 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 490/943] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:20:29 2022] GET /compute/v2.1/servers/80dda8a9-370d-4ebe-9d60-26a482c38a14 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:20:30.933536 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-5322e7fa-0cc0-49cd-8ca1-62fbbf82fa31 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:20:30.934111 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-5322e7fa-0cc0-49cd-8ca1-62fbbf82fa31 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] [instance: 80dda8a9-370d-4ebe-9d60-26a482c38a14] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:20:30.937475 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 17 03:20:30.937619 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Mon Oct 17 03:20:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/80dda8a9-370d-4ebe-9d60-26a482c38a14 (ip 10.222.0.27) !!! Oct 17 03:20:30.945176 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-5322e7fa-0cc0-49cd-8ca1-62fbbf82fa31 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:20:30.945657 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-5322e7fa-0cc0-49cd-8ca1-62fbbf82fa31 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:20:30.946086 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-5322e7fa-0cc0-49cd-8ca1-62fbbf82fa31 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:20:30.946776 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-5322e7fa-0cc0-49cd-8ca1-62fbbf82fa31 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:20:30.947248 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-5322e7fa-0cc0-49cd-8ca1-62fbbf82fa31 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:20:30.947666 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-5322e7fa-0cc0-49cd-8ca1-62fbbf82fa31 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:20:31.085231 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-5322e7fa-0cc0-49cd-8ca1-62fbbf82fa31 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30a0379df643ff81e1ca01f3e26d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '917f1029c33f4607b398287532f2fb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:20:31.095961 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-5322e7fa-0cc0-49cd-8ca1-62fbbf82fa31 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] 10.222.0.27 "GET /compute/v2.1/servers/80dda8a9-370d-4ebe-9d60-26a482c38a14" status: 200 len: 1266 microversion: 2.1 time: 0.166296 Oct 17 03:20:31.096517 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 454/944] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:20:30 2022] GET /compute/v2.1/servers/80dda8a9-370d-4ebe-9d60-26a482c38a14 => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:20:32.118987 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-0a3e02a7-03cd-4670-8229-1972fce9c44a tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:20:32.119594 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-0a3e02a7-03cd-4670-8229-1972fce9c44a tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] [instance: 80dda8a9-370d-4ebe-9d60-26a482c38a14] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:20:32.121989 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG dbcounter [-] [118886] Writing DB stats nova_cell0:SELECT=2 {{(pid=118886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:20:32.122649 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG dbcounter [-] [118886] Writing DB stats nova_cell0:SELECT=6 {{(pid=118886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:20:32.128590 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-0a3e02a7-03cd-4670-8229-1972fce9c44a tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:20:32.129011 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-0a3e02a7-03cd-4670-8229-1972fce9c44a tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:20:32.130198 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-0a3e02a7-03cd-4670-8229-1972fce9c44a tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:20:32.130933 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-0a3e02a7-03cd-4670-8229-1972fce9c44a tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:20:32.131389 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-0a3e02a7-03cd-4670-8229-1972fce9c44a tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:20:32.131858 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-0a3e02a7-03cd-4670-8229-1972fce9c44a tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:20:32.267255 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-0a3e02a7-03cd-4670-8229-1972fce9c44a tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30a0379df643ff81e1ca01f3e26d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '917f1029c33f4607b398287532f2fb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:20:32.275115 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-0a3e02a7-03cd-4670-8229-1972fce9c44a tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] 10.222.0.27 "GET /compute/v2.1/servers/80dda8a9-370d-4ebe-9d60-26a482c38a14" status: 200 len: 1266 microversion: 2.1 time: 0.160017 Oct 17 03:20:32.275687 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 491/945] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:20:32 2022] GET /compute/v2.1/servers/80dda8a9-370d-4ebe-9d60-26a482c38a14 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:20:33.297681 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-8a401849-73bc-45a6-ae7c-48c5afca2e15 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:20:33.298465 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-8a401849-73bc-45a6-ae7c-48c5afca2e15 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] [instance: 80dda8a9-370d-4ebe-9d60-26a482c38a14] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:20:33.300485 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG dbcounter [-] [118887] Writing DB stats nova_cell0:SELECT=12 {{(pid=118887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:20:33.303252 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG dbcounter [-] [118887] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=118887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:20:33.309781 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-8a401849-73bc-45a6-ae7c-48c5afca2e15 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:20:33.310346 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-8a401849-73bc-45a6-ae7c-48c5afca2e15 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:20:33.312314 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-8a401849-73bc-45a6-ae7c-48c5afca2e15 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:20:33.313314 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-8a401849-73bc-45a6-ae7c-48c5afca2e15 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:20:33.314029 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-8a401849-73bc-45a6-ae7c-48c5afca2e15 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:20:33.314530 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-8a401849-73bc-45a6-ae7c-48c5afca2e15 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:20:33.459175 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-8a401849-73bc-45a6-ae7c-48c5afca2e15 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30a0379df643ff81e1ca01f3e26d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '917f1029c33f4607b398287532f2fb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:20:33.467601 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-8a401849-73bc-45a6-ae7c-48c5afca2e15 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] 10.222.0.27 "GET /compute/v2.1/servers/80dda8a9-370d-4ebe-9d60-26a482c38a14" status: 200 len: 1266 microversion: 2.1 time: 0.173805 Oct 17 03:20:33.468191 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 455/946] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:20:33 2022] GET /compute/v2.1/servers/80dda8a9-370d-4ebe-9d60-26a482c38a14 => generated 1266 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:20:34.491998 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-bf09dc37-9bce-4386-b13b-0bc97b56e87e tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:20:34.492631 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-bf09dc37-9bce-4386-b13b-0bc97b56e87e tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] [instance: 80dda8a9-370d-4ebe-9d60-26a482c38a14] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:20:34.499162 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-bf09dc37-9bce-4386-b13b-0bc97b56e87e tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:20:34.499587 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-bf09dc37-9bce-4386-b13b-0bc97b56e87e tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:20:34.500025 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-bf09dc37-9bce-4386-b13b-0bc97b56e87e tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:20:34.500717 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-bf09dc37-9bce-4386-b13b-0bc97b56e87e tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:20:34.501169 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-bf09dc37-9bce-4386-b13b-0bc97b56e87e tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:20:34.501595 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-bf09dc37-9bce-4386-b13b-0bc97b56e87e tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:20:34.636138 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-bf09dc37-9bce-4386-b13b-0bc97b56e87e tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30a0379df643ff81e1ca01f3e26d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '917f1029c33f4607b398287532f2fb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:20:34.643780 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-bf09dc37-9bce-4386-b13b-0bc97b56e87e tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] 10.222.0.27 "GET /compute/v2.1/servers/80dda8a9-370d-4ebe-9d60-26a482c38a14" status: 200 len: 1266 microversion: 2.1 time: 0.156256 Oct 17 03:20:34.644376 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 492/947] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:20:34 2022] GET /compute/v2.1/servers/80dda8a9-370d-4ebe-9d60-26a482c38a14 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:20:35.666886 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-abf7376f-5684-4258-97a3-a7d4967bfe8b tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:20:35.667480 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-abf7376f-5684-4258-97a3-a7d4967bfe8b tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] [instance: 80dda8a9-370d-4ebe-9d60-26a482c38a14] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:20:35.673920 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-abf7376f-5684-4258-97a3-a7d4967bfe8b tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:20:35.674399 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-abf7376f-5684-4258-97a3-a7d4967bfe8b tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:20:35.674825 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-abf7376f-5684-4258-97a3-a7d4967bfe8b tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:20:35.675525 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-abf7376f-5684-4258-97a3-a7d4967bfe8b tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:20:35.675968 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-abf7376f-5684-4258-97a3-a7d4967bfe8b tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:20:35.677016 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-abf7376f-5684-4258-97a3-a7d4967bfe8b tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:20:35.808358 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-abf7376f-5684-4258-97a3-a7d4967bfe8b tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30a0379df643ff81e1ca01f3e26d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '917f1029c33f4607b398287532f2fb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:20:35.816063 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-abf7376f-5684-4258-97a3-a7d4967bfe8b tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] 10.222.0.27 "GET /compute/v2.1/servers/80dda8a9-370d-4ebe-9d60-26a482c38a14" status: 200 len: 1266 microversion: 2.1 time: 0.153272 Oct 17 03:20:35.816623 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 456/948] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:20:35 2022] GET /compute/v2.1/servers/80dda8a9-370d-4ebe-9d60-26a482c38a14 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:20:36.030379 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [req-a69a698b-3709-4a5f-b78e-2f4311cea234 req-3f7fbc23-8bb1-4a1a-a46f-6e3432ae1b26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80dda8a9-370d-4ebe-9d60-26a482c38a14", "name": "network-vif-plugged", "status": "completed", "tag": "eae0ee63-abc6-4231-af35-475536e08de6"}]} {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:20:36.042752 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [req-a69a698b-3709-4a5f-b78e-2f4311cea234 req-3f7fbc23-8bb1-4a1a-a46f-6e3432ae1b26 service nova] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:20:36.043252 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [req-a69a698b-3709-4a5f-b78e-2f4311cea234 req-3f7fbc23-8bb1-4a1a-a46f-6e3432ae1b26 service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:20:36.043678 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [req-a69a698b-3709-4a5f-b78e-2f4311cea234 req-3f7fbc23-8bb1-4a1a-a46f-6e3432ae1b26 service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:20:36.055551 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.compute.server_external_events [req-a69a698b-3709-4a5f-b78e-2f4311cea234 req-3f7fbc23-8bb1-4a1a-a46f-6e3432ae1b26 service nova] Creating event network-vif-plugged:eae0ee63-abc6-4231-af35-475536e08de6 for instance 80dda8a9-370d-4ebe-9d60-26a482c38a14 on hv-cinder-84697 Oct 17 03:20:36.060209 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [req-a69a698b-3709-4a5f-b78e-2f4311cea234 req-3f7fbc23-8bb1-4a1a-a46f-6e3432ae1b26 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033470 Oct 17 03:20:36.061079 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 493/949] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 03:20:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:20:36.839586 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-ad3a8bc7-fbfd-443c-b6f4-30297d363033 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:20:36.840181 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-ad3a8bc7-fbfd-443c-b6f4-30297d363033 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] [instance: 80dda8a9-370d-4ebe-9d60-26a482c38a14] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:20:36.846500 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-ad3a8bc7-fbfd-443c-b6f4-30297d363033 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:20:36.847003 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-ad3a8bc7-fbfd-443c-b6f4-30297d363033 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:20:36.847431 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-ad3a8bc7-fbfd-443c-b6f4-30297d363033 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:20:36.848152 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-ad3a8bc7-fbfd-443c-b6f4-30297d363033 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:20:36.848617 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-ad3a8bc7-fbfd-443c-b6f4-30297d363033 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:20:36.849017 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-ad3a8bc7-fbfd-443c-b6f4-30297d363033 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:20:36.976059 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-ad3a8bc7-fbfd-443c-b6f4-30297d363033 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30a0379df643ff81e1ca01f3e26d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '917f1029c33f4607b398287532f2fb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:20:36.983649 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-ad3a8bc7-fbfd-443c-b6f4-30297d363033 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] 10.222.0.27 "GET /compute/v2.1/servers/80dda8a9-370d-4ebe-9d60-26a482c38a14" status: 200 len: 1266 microversion: 2.1 time: 0.147897 Oct 17 03:20:36.984198 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 457/950] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:20:36 2022] GET /compute/v2.1/servers/80dda8a9-370d-4ebe-9d60-26a482c38a14 => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:20:38.007096 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-dd596bcb-6e5b-4a84-9370-c3bd3c9e0f08 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:20:38.007814 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-dd596bcb-6e5b-4a84-9370-c3bd3c9e0f08 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] [instance: 80dda8a9-370d-4ebe-9d60-26a482c38a14] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:20:38.009738 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG dbcounter [-] [118886] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=6 {{(pid=118886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:20:38.015138 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-dd596bcb-6e5b-4a84-9370-c3bd3c9e0f08 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:20:38.015656 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-dd596bcb-6e5b-4a84-9370-c3bd3c9e0f08 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:20:38.016165 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-dd596bcb-6e5b-4a84-9370-c3bd3c9e0f08 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:20:38.016859 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-dd596bcb-6e5b-4a84-9370-c3bd3c9e0f08 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:20:38.017349 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-dd596bcb-6e5b-4a84-9370-c3bd3c9e0f08 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:20:38.017783 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-dd596bcb-6e5b-4a84-9370-c3bd3c9e0f08 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:20:38.148988 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-dd596bcb-6e5b-4a84-9370-c3bd3c9e0f08 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30a0379df643ff81e1ca01f3e26d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '917f1029c33f4607b398287532f2fb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:20:38.156633 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-dd596bcb-6e5b-4a84-9370-c3bd3c9e0f08 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] 10.222.0.27 "GET /compute/v2.1/servers/80dda8a9-370d-4ebe-9d60-26a482c38a14" status: 200 len: 1453 microversion: 2.1 time: 0.154382 Oct 17 03:20:38.157195 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 494/951] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:20:38 2022] GET /compute/v2.1/servers/80dda8a9-370d-4ebe-9d60-26a482c38a14 => generated 1453 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:20:38.179617 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-ce5099df-cf85-4c8c-85a1-592daa68a685 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:20:38.180146 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-ce5099df-cf85-4c8c-85a1-592daa68a685 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] [instance: 80dda8a9-370d-4ebe-9d60-26a482c38a14] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:20:38.186439 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-ce5099df-cf85-4c8c-85a1-592daa68a685 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:20:38.186956 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-ce5099df-cf85-4c8c-85a1-592daa68a685 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:20:38.187395 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-ce5099df-cf85-4c8c-85a1-592daa68a685 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:20:38.188082 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-ce5099df-cf85-4c8c-85a1-592daa68a685 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:20:38.188535 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-ce5099df-cf85-4c8c-85a1-592daa68a685 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:20:38.188958 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-ce5099df-cf85-4c8c-85a1-592daa68a685 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:20:38.323016 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-ce5099df-cf85-4c8c-85a1-592daa68a685 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30a0379df643ff81e1ca01f3e26d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '917f1029c33f4607b398287532f2fb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:20:38.330687 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-ce5099df-cf85-4c8c-85a1-592daa68a685 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] 10.222.0.27 "GET /compute/v2.1/servers/80dda8a9-370d-4ebe-9d60-26a482c38a14" status: 200 len: 1453 microversion: 2.1 time: 0.154979 Oct 17 03:20:38.331289 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 458/952] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:20:38 2022] GET /compute/v2.1/servers/80dda8a9-370d-4ebe-9d60-26a482c38a14 => generated 1453 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:20:40.297375 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [req-44225fe7-c0ec-4306-98e3-9c9e1c82d825 req-6b56e73f-8993-46bb-8fd2-75e78c678fd0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80dda8a9-370d-4ebe-9d60-26a482c38a14", "tag": "eae0ee63-abc6-4231-af35-475536e08de6"}]} {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:20:40.307399 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [req-44225fe7-c0ec-4306-98e3-9c9e1c82d825 req-6b56e73f-8993-46bb-8fd2-75e78c678fd0 service nova] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:20:40.308147 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [req-44225fe7-c0ec-4306-98e3-9c9e1c82d825 req-6b56e73f-8993-46bb-8fd2-75e78c678fd0 service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:20:40.308627 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [req-44225fe7-c0ec-4306-98e3-9c9e1c82d825 req-6b56e73f-8993-46bb-8fd2-75e78c678fd0 service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:20:40.319992 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.compute.server_external_events [req-44225fe7-c0ec-4306-98e3-9c9e1c82d825 req-6b56e73f-8993-46bb-8fd2-75e78c678fd0 service nova] Creating event network-changed:eae0ee63-abc6-4231-af35-475536e08de6 for instance 80dda8a9-370d-4ebe-9d60-26a482c38a14 on hv-cinder-84697 Oct 17 03:20:40.325373 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [req-44225fe7-c0ec-4306-98e3-9c9e1c82d825 req-6b56e73f-8993-46bb-8fd2-75e78c678fd0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031730 Oct 17 03:20:40.326161 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 495/953] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 03:20:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:21:01.735687 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-b81a4ad9-e416-4ea8-9bac-1212b1f0670f tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-860597188"}} {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:21:01.736241 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-b81a4ad9-e416-4ea8-9bac-1212b1f0670f tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] [instance: 96327956-efab-40b1-8b99-628ab19623be] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:21:01.738434 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG dbcounter [-] [118887] Writing DB stats nova_api:SELECT=7 {{(pid=118887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:21:01.739494 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG dbcounter [-] [118887] Writing DB stats nova_cell1:SELECT=42 {{(pid=118887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:21:01.744988 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-b81a4ad9-e416-4ea8-9bac-1212b1f0670f tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:21:01.745465 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-b81a4ad9-e416-4ea8-9bac-1212b1f0670f tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:21:01.745894 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-b81a4ad9-e416-4ea8-9bac-1212b1f0670f tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:21:01.746578 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-b81a4ad9-e416-4ea8-9bac-1212b1f0670f tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:21:01.747060 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-b81a4ad9-e416-4ea8-9bac-1212b1f0670f tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:21:01.747503 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-b81a4ad9-e416-4ea8-9bac-1212b1f0670f tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:21:01.872860 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.network.security_group_api [None req-b81a4ad9-e416-4ea8-9bac-1212b1f0670f tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Removing security group d1049b4a-f0bc-41f5-920c-abf5f7633e3a from port ac441b28-2717-4b03-ba74-cb37f802decc Oct 17 03:21:02.181164 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-b81a4ad9-e416-4ea8-9bac-1212b1f0670f tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] 10.222.0.27 "POST /compute/v2.1/servers/96327956-efab-40b1-8b99-628ab19623be/action" status: 202 len: 0 microversion: 2.1 time: 0.449319 Oct 17 03:21:02.182109 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 459/954] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 03:21:01 2022] POST /compute/v2.1/servers/96327956-efab-40b1-8b99-628ab19623be/action => generated 0 bytes in 451 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 03:21:02.193007 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [req-5b1b47b9-c227-4116-92bc-30f05a5714d1 req-bdc671e7-dfbb-47ab-99a1-3c1caab7930c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96327956-efab-40b1-8b99-628ab19623be", "tag": "ac441b28-2717-4b03-ba74-cb37f802decc"}]} {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:21:02.198566 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG dbcounter [-] [118886] Writing DB stats nova_api:SELECT=3 {{(pid=118886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:21:02.200142 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG dbcounter [-] [118886] Writing DB stats nova_cell1:SELECT=70 {{(pid=118886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:21:02.206896 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [req-5b1b47b9-c227-4116-92bc-30f05a5714d1 req-bdc671e7-dfbb-47ab-99a1-3c1caab7930c service nova] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:21:02.206896 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [req-5b1b47b9-c227-4116-92bc-30f05a5714d1 req-bdc671e7-dfbb-47ab-99a1-3c1caab7930c service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:21:02.207511 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [req-5b1b47b9-c227-4116-92bc-30f05a5714d1 req-bdc671e7-dfbb-47ab-99a1-3c1caab7930c service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:21:02.219438 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.compute.server_external_events [req-5b1b47b9-c227-4116-92bc-30f05a5714d1 req-bdc671e7-dfbb-47ab-99a1-3c1caab7930c service nova] Creating event network-changed:ac441b28-2717-4b03-ba74-cb37f802decc for instance 96327956-efab-40b1-8b99-628ab19623be on hv-cinder-84697 Oct 17 03:21:02.224941 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [req-5b1b47b9-c227-4116-92bc-30f05a5714d1 req-bdc671e7-dfbb-47ab-99a1-3c1caab7930c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036971 Oct 17 03:21:02.225712 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 496/955] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 03:21:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:21:03.520875 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-3376342e-adee-4a11-b7c4-c6fdafc33fd2 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:21:03.521374 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-3376342e-adee-4a11-b7c4-c6fdafc33fd2 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] [instance: 96327956-efab-40b1-8b99-628ab19623be] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:21:03.527457 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-3376342e-adee-4a11-b7c4-c6fdafc33fd2 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:21:03.527949 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-3376342e-adee-4a11-b7c4-c6fdafc33fd2 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:21:03.528384 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-3376342e-adee-4a11-b7c4-c6fdafc33fd2 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:21:03.529075 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-3376342e-adee-4a11-b7c4-c6fdafc33fd2 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:21:03.529528 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-3376342e-adee-4a11-b7c4-c6fdafc33fd2 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:21:03.529953 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-3376342e-adee-4a11-b7c4-c6fdafc33fd2 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:21:03.609517 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.objects.instance [None req-3376342e-adee-4a11-b7c4-c6fdafc33fd2 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lazy-loading 'services' on Instance uuid 96327956-efab-40b1-8b99-628ab19623be {{(pid=118887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 03:21:03.681697 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-3376342e-adee-4a11-b7c4-c6fdafc33fd2 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] 10.222.0.27 "DELETE /compute/v2.1/servers/96327956-efab-40b1-8b99-628ab19623be/os-volume_attachments/c8015d08-b418-4d71-b694-721468009b40" status: 202 len: 0 microversion: 2.1 time: 0.165123 Oct 17 03:21:03.682550 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 460/956] 10.222.0.27 () {58 vars in 1416 bytes} [Mon Oct 17 03:21:03 2022] DELETE /compute/v2.1/servers/96327956-efab-40b1-8b99-628ab19623be/os-volume_attachments/c8015d08-b418-4d71-b694-721468009b40 => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 03:21:03.692688 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-248f7ac4-4a97-406f-ac56-ae3317d22c85 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:21:03.694987 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-248f7ac4-4a97-406f-ac56-ae3317d22c85 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] [instance: 96327956-efab-40b1-8b99-628ab19623be] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:21:03.701891 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-248f7ac4-4a97-406f-ac56-ae3317d22c85 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:21:03.702476 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-248f7ac4-4a97-406f-ac56-ae3317d22c85 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:21:03.703259 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-248f7ac4-4a97-406f-ac56-ae3317d22c85 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:21:03.704160 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-248f7ac4-4a97-406f-ac56-ae3317d22c85 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:21:03.704621 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-248f7ac4-4a97-406f-ac56-ae3317d22c85 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:21:03.705050 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-248f7ac4-4a97-406f-ac56-ae3317d22c85 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:21:03.737232 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-248f7ac4-4a97-406f-ac56-ae3317d22c85 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] 10.222.0.27 "GET /compute/v2.1/servers/96327956-efab-40b1-8b99-628ab19623be/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050018 Oct 17 03:21:03.737815 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 497/957] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 17 03:21:03 2022] GET /compute/v2.1/servers/96327956-efab-40b1-8b99-628ab19623be/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:21:04.242633 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [req-64cee823-ceb3-4458-bd28-cf0aacd856e9 req-26ab340c-289c-4e44-ad81-c2266a171867 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96327956-efab-40b1-8b99-628ab19623be", "tag": "ac441b28-2717-4b03-ba74-cb37f802decc"}]} {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:21:04.253762 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [req-64cee823-ceb3-4458-bd28-cf0aacd856e9 req-26ab340c-289c-4e44-ad81-c2266a171867 service nova] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:21:04.254289 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [req-64cee823-ceb3-4458-bd28-cf0aacd856e9 req-26ab340c-289c-4e44-ad81-c2266a171867 service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:21:04.254934 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [req-64cee823-ceb3-4458-bd28-cf0aacd856e9 req-26ab340c-289c-4e44-ad81-c2266a171867 service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:21:04.267588 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.compute.server_external_events [req-64cee823-ceb3-4458-bd28-cf0aacd856e9 req-26ab340c-289c-4e44-ad81-c2266a171867 service nova] Creating event network-changed:ac441b28-2717-4b03-ba74-cb37f802decc for instance 96327956-efab-40b1-8b99-628ab19623be on hv-cinder-84697 Oct 17 03:21:04.273076 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [req-64cee823-ceb3-4458-bd28-cf0aacd856e9 req-26ab340c-289c-4e44-ad81-c2266a171867 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034718 Oct 17 03:21:04.273861 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 461/958] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 03:21:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 03:21:04.750317 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-d5256d5c-f7e8-4f2f-9ede-6147b36601d2 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:21:04.752658 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-d5256d5c-f7e8-4f2f-9ede-6147b36601d2 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] [instance: 96327956-efab-40b1-8b99-628ab19623be] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:21:04.759105 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-d5256d5c-f7e8-4f2f-9ede-6147b36601d2 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:21:04.759592 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-d5256d5c-f7e8-4f2f-9ede-6147b36601d2 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:21:04.760026 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-d5256d5c-f7e8-4f2f-9ede-6147b36601d2 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:21:04.760721 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-d5256d5c-f7e8-4f2f-9ede-6147b36601d2 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:21:04.761172 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-d5256d5c-f7e8-4f2f-9ede-6147b36601d2 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:21:04.761598 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-d5256d5c-f7e8-4f2f-9ede-6147b36601d2 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:21:04.791886 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-d5256d5c-f7e8-4f2f-9ede-6147b36601d2 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] 10.222.0.27 "GET /compute/v2.1/servers/96327956-efab-40b1-8b99-628ab19623be/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045497 Oct 17 03:21:04.792706 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 498/959] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 17 03:21:04 2022] GET /compute/v2.1/servers/96327956-efab-40b1-8b99-628ab19623be/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 03:21:04.804559 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-93b48e4e-c566-43fe-ac8f-8bd16cdff372 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:21:04.805156 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-93b48e4e-c566-43fe-ac8f-8bd16cdff372 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] [instance: 96327956-efab-40b1-8b99-628ab19623be] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:21:04.811665 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-93b48e4e-c566-43fe-ac8f-8bd16cdff372 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:21:04.812147 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-93b48e4e-c566-43fe-ac8f-8bd16cdff372 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:21:04.812575 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-93b48e4e-c566-43fe-ac8f-8bd16cdff372 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:21:04.813248 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-93b48e4e-c566-43fe-ac8f-8bd16cdff372 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:21:04.813692 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-93b48e4e-c566-43fe-ac8f-8bd16cdff372 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:21:04.814110 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-93b48e4e-c566-43fe-ac8f-8bd16cdff372 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:21:04.886692 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.wsgi [None req-93b48e4e-c566-43fe-ac8f-8bd16cdff372 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] HTTP exception thrown: Instance 96327956-efab-40b1-8b99-628ab19623be is not attached to volume c8015d08-b418-4d71-b694-721468009b40 Oct 17 03:21:04.889149 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-93b48e4e-c566-43fe-ac8f-8bd16cdff372 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Request method failure captured: Oct 17 03:21:04.889149 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: request: DELETE /compute/v2.1/servers/96327956-efab-40b1-8b99-628ab19623be/os-volume_attachments/c8015d08-b418-4d71-b694-721468009b40 HTTP/1.1 Oct 17 03:21:04.889149 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Accept: application/json Oct 17 03:21:04.889149 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Accept-Encoding: identity Oct 17 03:21:04.889149 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Connection: close Oct 17 03:21:04.889149 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Content-Length: 0 Oct 17 03:21:04.889149 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Content-Type: application/json Oct 17 03:21:04.889149 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Host: 10.222.0.27 Oct 17 03:21:04.889149 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Openstack-System-Scope: None Oct 17 03:21:04.889149 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: User-Agent: python-urllib3/1.26.12 Oct 17 03:21:04.889149 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Auth-Token: gAAAAABjTMmNLX7vBxqZHiq8U00xByGN7HQfvVa37TAXT2kaZ7JxjJLPN8d9WSofOep2htlKZVjLGZVUwjHGVbUpDOH3T-OIf0v0ZuXmbrUkZVqJAgYGcOQBheHWixUrZmRk0cbLcFVh6GPp3wraQxt0pKF6sth-MRYFKko09dCM24hz030Sx-M Oct 17 03:21:04.889149 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Domain-Id: None Oct 17 03:21:04.889149 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Domain-Name: None Oct 17 03:21:04.889149 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Identity-Status: Confirmed Oct 17 03:21:04.889149 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Is-Admin-Project: True Oct 17 03:21:04.889149 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Project-Domain-Id: default Oct 17 03:21:04.889149 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Project-Domain-Name: Default Oct 17 03:21:04.889149 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Project-Id: dc518d9b31644a8d8b21cf9c645b1373 Oct 17 03:21:04.889149 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Project-Name: tempest-TestMinimumBasicScenario-752845987 Oct 17 03:21:04.889149 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Role: member,reader Oct 17 03:21:04.889149 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Roles: member,reader Oct 17 03:21:04.890840 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/dc518d9b31644a8d8b21cf9c645b1373"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/dc518d9b31644a8d8b21cf9c645b1373"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/dc518d9b31644a8d8b21cf9c645b1373"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_dc518d9b31644a8d8b21cf9c645b1373"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 17 03:21:04.890840 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Tenant: tempest-TestMinimumBasicScenario-752845987 Oct 17 03:21:04.890840 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Tenant-Id: dc518d9b31644a8d8b21cf9c645b1373 Oct 17 03:21:04.890840 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Tenant-Name: tempest-TestMinimumBasicScenario-752845987 Oct 17 03:21:04.890840 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-User: tempest-TestMinimumBasicScenario-752845987-project Oct 17 03:21:04.890840 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-User-Domain-Id: default Oct 17 03:21:04.890840 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-User-Domain-Name: Default Oct 17 03:21:04.890840 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-User-Id: 82da4b8f8bdb4dbab655ff510bfa328f Oct 17 03:21:04.890840 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-User-Name: tempest-TestMinimumBasicScenario-752845987-project Oct 17 03:21:04.890840 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: method: > Oct 17 03:21:04.890840 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: exception: Instance 96327956-efab-40b1-8b99-628ab19623be is not attached to volume c8015d08-b418-4d71-b694-721468009b40 Oct 17 03:21:04.891966 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: action_args: {'server_id': '96327956-efab-40b1-8b99-628ab19623be', 'id': 'c8015d08-b418-4d71-b694-721468009b40'} Oct 17 03:21:04.891966 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 03:21:04.891966 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:21:04.891966 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 17 03:21:04.891966 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 17 03:21:04.891966 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 03:21:04.891966 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 03:21:04.891966 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 17 03:21:04.891966 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 17 03:21:04.891966 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id c8015d08-b418-4d71-b694-721468009b40. Oct 17 03:21:04.891966 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Oct 17 03:21:04.891966 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:21:04.891966 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Oct 17 03:21:04.891966 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:21:04.891966 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:21:04.891966 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:21:04.891966 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 03:21:04.891966 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 03:21:04.891966 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 03:21:04.893544 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 03:21:04.893544 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 17 03:21:04.893544 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 17 03:21:04.893544 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96327956-efab-40b1-8b99-628ab19623be is not attached to volume c8015d08-b418-4d71-b694-721468009b40 Oct 17 03:21:04.893544 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Oct 17 03:21:04.893544 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:21:04.893544 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Oct 17 03:21:04.893544 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:21:04.893544 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:21:04.893544 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:21:04.893544 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 03:21:04.893544 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 03:21:04.893544 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96327956-efab-40b1-8b99-628ab19623be is not attached to volume c8015d08-b418-4d71-b694-721468009b40 Oct 17 03:21:04.893544 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Oct 17 03:21:04.893544 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-93b48e4e-c566-43fe-ac8f-8bd16cdff372 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Returning 404 to user: Instance 96327956-efab-40b1-8b99-628ab19623be is not attached to volume c8015d08-b418-4d71-b694-721468009b40 {{(pid=118887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 03:21:04.895522 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-93b48e4e-c566-43fe-ac8f-8bd16cdff372 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] 10.222.0.27 "DELETE /compute/v2.1/servers/96327956-efab-40b1-8b99-628ab19623be/os-volume_attachments/c8015d08-b418-4d71-b694-721468009b40" status: 404 len: 154 microversion: 2.1 time: 0.090889 Oct 17 03:21:04.895522 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 462/960] 10.222.0.27 () {58 vars in 1416 bytes} [Mon Oct 17 03:21:04 2022] DELETE /compute/v2.1/servers/96327956-efab-40b1-8b99-628ab19623be/os-volume_attachments/c8015d08-b418-4d71-b694-721468009b40 => generated 154 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 03:21:06.032968 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-2bb19248-457f-44cb-9800-0b5b4625f910 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:21:06.033466 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-2bb19248-457f-44cb-9800-0b5b4625f910 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] [instance: 96327956-efab-40b1-8b99-628ab19623be] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:21:06.040371 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-2bb19248-457f-44cb-9800-0b5b4625f910 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:21:06.040851 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-2bb19248-457f-44cb-9800-0b5b4625f910 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:21:06.041282 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-2bb19248-457f-44cb-9800-0b5b4625f910 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:21:06.041968 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-2bb19248-457f-44cb-9800-0b5b4625f910 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:21:06.042416 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-2bb19248-457f-44cb-9800-0b5b4625f910 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:21:06.042837 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-2bb19248-457f-44cb-9800-0b5b4625f910 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:21:06.067629 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-2bb19248-457f-44cb-9800-0b5b4625f910 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] [instance: 96327956-efab-40b1-8b99-628ab19623be] Going to try to terminate instance {{(pid=118886) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 03:21:06.141140 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-2bb19248-457f-44cb-9800-0b5b4625f910 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] 10.222.0.27 "DELETE /compute/v2.1/servers/96327956-efab-40b1-8b99-628ab19623be" status: 204 len: 0 microversion: 2.1 time: 0.111683 Oct 17 03:21:06.141980 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 499/961] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 03:21:06 2022] DELETE /compute/v2.1/servers/96327956-efab-40b1-8b99-628ab19623be => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 03:21:06.151112 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-7a4f43b1-fe5f-48c0-95da-8d0e0fa28edd tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:21:06.151726 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-7a4f43b1-fe5f-48c0-95da-8d0e0fa28edd tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] [instance: 96327956-efab-40b1-8b99-628ab19623be] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:21:06.157829 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-7a4f43b1-fe5f-48c0-95da-8d0e0fa28edd tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:21:06.158293 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-7a4f43b1-fe5f-48c0-95da-8d0e0fa28edd tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:21:06.158735 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-7a4f43b1-fe5f-48c0-95da-8d0e0fa28edd tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:21:06.159450 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-7a4f43b1-fe5f-48c0-95da-8d0e0fa28edd tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:21:06.159907 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-7a4f43b1-fe5f-48c0-95da-8d0e0fa28edd tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:21:06.160936 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-7a4f43b1-fe5f-48c0-95da-8d0e0fa28edd tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:21:06.290233 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-7a4f43b1-fe5f-48c0-95da-8d0e0fa28edd tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82da4b8f8bdb4dbab655ff510bfa328f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc518d9b31644a8d8b21cf9c645b1373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:21:06.297849 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-7a4f43b1-fe5f-48c0-95da-8d0e0fa28edd tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] 10.222.0.27 "GET /compute/v2.1/servers/96327956-efab-40b1-8b99-628ab19623be" status: 200 len: 1553 microversion: 2.1 time: 0.150826 Oct 17 03:21:06.298402 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 463/962] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:21:06 2022] GET /compute/v2.1/servers/96327956-efab-40b1-8b99-628ab19623be => generated 1553 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:21:07.321095 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-ba2a4263-11d0-432a-8df4-7739110c0fef tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:21:07.321785 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-ba2a4263-11d0-432a-8df4-7739110c0fef tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] [instance: 96327956-efab-40b1-8b99-628ab19623be] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:21:07.328092 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-ba2a4263-11d0-432a-8df4-7739110c0fef tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:21:07.328564 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-ba2a4263-11d0-432a-8df4-7739110c0fef tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:21:07.328992 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-ba2a4263-11d0-432a-8df4-7739110c0fef tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:21:07.329670 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-ba2a4263-11d0-432a-8df4-7739110c0fef tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:21:07.330116 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-ba2a4263-11d0-432a-8df4-7739110c0fef tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:21:07.330532 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-ba2a4263-11d0-432a-8df4-7739110c0fef tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:21:07.460673 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-ba2a4263-11d0-432a-8df4-7739110c0fef tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82da4b8f8bdb4dbab655ff510bfa328f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc518d9b31644a8d8b21cf9c645b1373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:21:07.468374 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-ba2a4263-11d0-432a-8df4-7739110c0fef tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] 10.222.0.27 "GET /compute/v2.1/servers/96327956-efab-40b1-8b99-628ab19623be" status: 200 len: 1553 microversion: 2.1 time: 0.151630 Oct 17 03:21:07.468928 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 500/963] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:21:07 2022] GET /compute/v2.1/servers/96327956-efab-40b1-8b99-628ab19623be => generated 1553 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:21:08.492733 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-3b8c69d4-3beb-41cf-8c7f-93c252ee49a2 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:21:08.494017 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-3b8c69d4-3beb-41cf-8c7f-93c252ee49a2 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] [instance: 96327956-efab-40b1-8b99-628ab19623be] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:21:08.500649 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-3b8c69d4-3beb-41cf-8c7f-93c252ee49a2 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:21:08.501122 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-3b8c69d4-3beb-41cf-8c7f-93c252ee49a2 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:21:08.501728 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-3b8c69d4-3beb-41cf-8c7f-93c252ee49a2 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:21:08.502419 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-3b8c69d4-3beb-41cf-8c7f-93c252ee49a2 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:21:08.502882 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-3b8c69d4-3beb-41cf-8c7f-93c252ee49a2 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:21:08.503744 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-3b8c69d4-3beb-41cf-8c7f-93c252ee49a2 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:21:08.736587 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-3b8c69d4-3beb-41cf-8c7f-93c252ee49a2 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82da4b8f8bdb4dbab655ff510bfa328f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc518d9b31644a8d8b21cf9c645b1373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:21:08.745156 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-3b8c69d4-3beb-41cf-8c7f-93c252ee49a2 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] 10.222.0.27 "GET /compute/v2.1/servers/96327956-efab-40b1-8b99-628ab19623be" status: 200 len: 1511 microversion: 2.1 time: 0.256856 Oct 17 03:21:08.745719 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 464/964] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:21:08 2022] GET /compute/v2.1/servers/96327956-efab-40b1-8b99-628ab19623be => generated 1511 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:21:08.764187 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [req-f7ecb2fc-4fce-4d9b-a701-3bd3fd79e026 req-7e4cfbf2-bbbb-4f5f-82ce-31b7d9cbf3d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96327956-efab-40b1-8b99-628ab19623be", "name": "network-vif-deleted", "tag": "ac441b28-2717-4b03-ba74-cb37f802decc"}]} {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:21:08.774440 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [req-f7ecb2fc-4fce-4d9b-a701-3bd3fd79e026 req-7e4cfbf2-bbbb-4f5f-82ce-31b7d9cbf3d1 service nova] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:21:08.774941 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [req-f7ecb2fc-4fce-4d9b-a701-3bd3fd79e026 req-7e4cfbf2-bbbb-4f5f-82ce-31b7d9cbf3d1 service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:21:08.775371 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [req-f7ecb2fc-4fce-4d9b-a701-3bd3fd79e026 req-7e4cfbf2-bbbb-4f5f-82ce-31b7d9cbf3d1 service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:21:08.787876 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.compute.server_external_events [req-f7ecb2fc-4fce-4d9b-a701-3bd3fd79e026 req-7e4cfbf2-bbbb-4f5f-82ce-31b7d9cbf3d1 service nova] Creating event network-vif-deleted:ac441b28-2717-4b03-ba74-cb37f802decc for instance 96327956-efab-40b1-8b99-628ab19623be on hv-cinder-84697 Oct 17 03:21:08.792861 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [req-f7ecb2fc-4fce-4d9b-a701-3bd3fd79e026 req-7e4cfbf2-bbbb-4f5f-82ce-31b7d9cbf3d1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032522 Oct 17 03:21:08.793457 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 501/965] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 03:21:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:21:09.769066 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-63e50eef-ab3d-4881-8081-8a68b8161987 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:21:09.769714 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-63e50eef-ab3d-4881-8081-8a68b8161987 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] [instance: 96327956-efab-40b1-8b99-628ab19623be] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:21:09.776838 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-63e50eef-ab3d-4881-8081-8a68b8161987 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:21:09.777326 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-63e50eef-ab3d-4881-8081-8a68b8161987 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:21:09.777732 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-63e50eef-ab3d-4881-8081-8a68b8161987 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:21:09.778408 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-63e50eef-ab3d-4881-8081-8a68b8161987 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:21:09.778850 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-63e50eef-ab3d-4881-8081-8a68b8161987 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:21:09.779289 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-63e50eef-ab3d-4881-8081-8a68b8161987 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:21:09.792660 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.wsgi [None req-63e50eef-ab3d-4881-8081-8a68b8161987 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] HTTP exception thrown: Instance 96327956-efab-40b1-8b99-628ab19623be could not be found. Oct 17 03:21:09.794139 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-63e50eef-ab3d-4881-8081-8a68b8161987 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Request method failure captured: Oct 17 03:21:09.794139 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: request: GET /compute/v2.1/servers/96327956-efab-40b1-8b99-628ab19623be HTTP/1.1 Oct 17 03:21:09.794139 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Accept: application/json Oct 17 03:21:09.794139 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Accept-Encoding: identity Oct 17 03:21:09.794139 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Connection: close Oct 17 03:21:09.794139 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Content-Length: 0 Oct 17 03:21:09.794139 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Content-Type: application/json Oct 17 03:21:09.794139 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Host: 10.222.0.27 Oct 17 03:21:09.794139 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Openstack-System-Scope: None Oct 17 03:21:09.794139 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: User-Agent: python-urllib3/1.26.12 Oct 17 03:21:09.794139 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Auth-Token: gAAAAABjTMmNLX7vBxqZHiq8U00xByGN7HQfvVa37TAXT2kaZ7JxjJLPN8d9WSofOep2htlKZVjLGZVUwjHGVbUpDOH3T-OIf0v0ZuXmbrUkZVqJAgYGcOQBheHWixUrZmRk0cbLcFVh6GPp3wraQxt0pKF6sth-MRYFKko09dCM24hz030Sx-M Oct 17 03:21:09.794139 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Domain-Id: None Oct 17 03:21:09.794139 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Domain-Name: None Oct 17 03:21:09.794139 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Identity-Status: Confirmed Oct 17 03:21:09.794139 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Is-Admin-Project: True Oct 17 03:21:09.794139 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Project-Domain-Id: default Oct 17 03:21:09.794139 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Project-Domain-Name: Default Oct 17 03:21:09.794139 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Project-Id: dc518d9b31644a8d8b21cf9c645b1373 Oct 17 03:21:09.794139 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Project-Name: tempest-TestMinimumBasicScenario-752845987 Oct 17 03:21:09.794139 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Role: member,reader Oct 17 03:21:09.794139 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Roles: member,reader Oct 17 03:21:09.795785 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/dc518d9b31644a8d8b21cf9c645b1373"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/dc518d9b31644a8d8b21cf9c645b1373"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/dc518d9b31644a8d8b21cf9c645b1373"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_dc518d9b31644a8d8b21cf9c645b1373"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 17 03:21:09.795785 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Tenant: tempest-TestMinimumBasicScenario-752845987 Oct 17 03:21:09.795785 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Tenant-Id: dc518d9b31644a8d8b21cf9c645b1373 Oct 17 03:21:09.795785 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Tenant-Name: tempest-TestMinimumBasicScenario-752845987 Oct 17 03:21:09.795785 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-User: tempest-TestMinimumBasicScenario-752845987-project Oct 17 03:21:09.795785 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-User-Domain-Id: default Oct 17 03:21:09.795785 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-User-Domain-Name: Default Oct 17 03:21:09.795785 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-User-Id: 82da4b8f8bdb4dbab655ff510bfa328f Oct 17 03:21:09.795785 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-User-Name: tempest-TestMinimumBasicScenario-752845987-project Oct 17 03:21:09.795785 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: method: > Oct 17 03:21:09.795785 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: exception: Instance 96327956-efab-40b1-8b99-628ab19623be could not be found. Oct 17 03:21:09.795785 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: action_args: {'id': '96327956-efab-40b1-8b99-628ab19623be'} Oct 17 03:21:09.796826 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 03:21:09.796826 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:21:09.796826 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 03:21:09.796826 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 03:21:09.796826 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 03:21:09.796826 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 03:21:09.796826 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 03:21:09.796826 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 03:21:09.796826 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 03:21:09.796826 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 03:21:09.796826 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96327956-efab-40b1-8b99-628ab19623be could not be found. Oct 17 03:21:09.796826 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Oct 17 03:21:09.796826 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:21:09.796826 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Oct 17 03:21:09.796826 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:21:09.796826 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:21:09.796826 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:21:09.796826 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 03:21:09.796826 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 03:21:09.796826 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 03:21:09.798341 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 03:21:09.798341 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 03:21:09.798341 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 03:21:09.798341 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 03:21:09.798341 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 03:21:09.798341 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 03:21:09.798341 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 03:21:09.798341 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96327956-efab-40b1-8b99-628ab19623be could not be found. Oct 17 03:21:09.798341 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Oct 17 03:21:09.798341 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:21:09.798341 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Oct 17 03:21:09.798341 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:21:09.798341 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:21:09.798341 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:21:09.798341 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 03:21:09.798341 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 03:21:09.798341 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96327956-efab-40b1-8b99-628ab19623be could not be found. Oct 17 03:21:09.798341 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Oct 17 03:21:09.799916 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-63e50eef-ab3d-4881-8081-8a68b8161987 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Returning 404 to user: Instance 96327956-efab-40b1-8b99-628ab19623be could not be found. {{(pid=118887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 03:21:09.799916 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-63e50eef-ab3d-4881-8081-8a68b8161987 tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] 10.222.0.27 "GET /compute/v2.1/servers/96327956-efab-40b1-8b99-628ab19623be" status: 404 len: 111 microversion: 2.1 time: 0.030270 Oct 17 03:21:09.799916 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 465/966] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:21:09 2022] GET /compute/v2.1/servers/96327956-efab-40b1-8b99-628ab19623be => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 03:21:09.805676 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-6fa51fcd-aac8-41dd-bc26-197f135bce5f tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] Calling method '.version_select at 0x7fc701803040>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:21:09.827188 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-6fa51fcd-aac8-41dd-bc26-197f135bce5f tempest-TestMinimumBasicScenario-752845987 tempest-TestMinimumBasicScenario-752845987-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1388360878" status: 202 len: 0 microversion: 2.1 time: 0.026528 Oct 17 03:21:09.827744 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 502/967] 10.222.0.27 () {58 vars in 1272 bytes} [Mon Oct 17 03:21:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1388360878 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 03:21:27.117150 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG dbcounter [-] [118887] Writing DB stats nova_api:SELECT=14 {{(pid=118887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:21:27.119236 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG dbcounter [-] [118887] Writing DB stats nova_cell1:SELECT=35,nova_cell1:INSERT=1 {{(pid=118887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:21:27.320091 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-6afc37be-1b14-4d97-975b-8189cad0e0e6 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Action: 'create', calling method: .version_select at 0x7fc70168c3a0>, body: {"keypair": {"name": "tempest-TestShelveInstance-393263813", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAMUEu7u0Q67AGQTO6Ifqmw+zIpoY/TNeUr7OkaPZXb59shUTG6YBPEyLnKGbbrb7RDRq74frNMyS3h31WLjyRli0lYhoOo0sKG/oZlxSnlemZ5P3lApH4TZGWsYIasJjw=="}} {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:21:27.337164 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.quota [None req-6afc37be-1b14-4d97-975b-8189cad0e0e6 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Getting quotas for project f7a92b100ac14d44aff5e4083a49f5ad. Resources: {'key_pairs'} {{(pid=118887) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 03:21:27.341606 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.quota [None req-6afc37be-1b14-4d97-975b-8189cad0e0e6 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Getting quotas for user 2969d23a676c4b7fb6c7b611c5999fa4 and project f7a92b100ac14d44aff5e4083a49f5ad. Resources: {'key_pairs'} {{(pid=118887) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 03:21:27.368579 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-6afc37be-1b14-4d97-975b-8189cad0e0e6 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.256609 Oct 17 03:21:27.369252 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 466/968] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 17 03:21:27 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 03:21:44.708321 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG dbcounter [-] [118886] Writing DB stats nova_cell1:SELECT=36,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:21:44.709639 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG dbcounter [-] [118886] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:21:44.714219 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-2250c4f8-a70a-4df3-b7ae-aa364013444b tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-863711421", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-393263813", "security_groups": [{"name": "tempest-secgroup-smoke-200355809"}], "networks": [{"uuid": "d6a2b611-0809-4328-b56f-ab1d9ab2417d"}], "block_device_mapping_v2": [{"uuid": "868612cf-c9fa-4d70-ac82-3dbc48d8be17", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:21:45.139267 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.network.neutron [None req-2250c4f8-a70a-4df3-b7ae-aa364013444b tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] validate_networks() for [('d6a2b611-0809-4328-b56f-ab1d9ab2417d', None, None, None, None, None)] {{(pid=118886) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 03:21:45.499361 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.virt.hardware [None req-2250c4f8-a70a-4df3-b7ae-aa364013444b tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Flavor limits 0:0:0 {{(pid=118886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 03:21:45.499777 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.virt.hardware [None req-2250c4f8-a70a-4df3-b7ae-aa364013444b tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Image limits 0:0:0 {{(pid=118886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 03:21:45.500243 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.virt.hardware [None req-2250c4f8-a70a-4df3-b7ae-aa364013444b tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Flavor pref 0:0:0 {{(pid=118886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 03:21:45.500645 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.virt.hardware [None req-2250c4f8-a70a-4df3-b7ae-aa364013444b tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Image pref 0:0:0 {{(pid=118886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 03:21:45.501049 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.virt.hardware [None req-2250c4f8-a70a-4df3-b7ae-aa364013444b tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 03:21:45.509763 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-2250c4f8-a70a-4df3-b7ae-aa364013444b tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:21:45.510232 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-2250c4f8-a70a-4df3-b7ae-aa364013444b tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:21:45.510659 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-2250c4f8-a70a-4df3-b7ae-aa364013444b tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:21:45.511408 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-2250c4f8-a70a-4df3-b7ae-aa364013444b tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:21:45.511855 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-2250c4f8-a70a-4df3-b7ae-aa364013444b tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:21:45.512271 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-2250c4f8-a70a-4df3-b7ae-aa364013444b tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:21:45.528479 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.quota [None req-2250c4f8-a70a-4df3-b7ae-aa364013444b tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Getting quotas for project f7a92b100ac14d44aff5e4083a49f5ad. Resources: {'instances', 'cores', 'ram'} {{(pid=118886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 03:21:45.532355 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.quota [None req-2250c4f8-a70a-4df3-b7ae-aa364013444b tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Getting quotas for user 2969d23a676c4b7fb6c7b611c5999fa4 and project f7a92b100ac14d44aff5e4083a49f5ad. Resources: {'instances', 'cores', 'ram'} {{(pid=118886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 03:21:45.587983 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-2250c4f8-a70a-4df3-b7ae-aa364013444b tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Going to run 1 instances... {{(pid=118886) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 03:21:45.590164 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-2250c4f8-a70a-4df3-b7ae-aa364013444b tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] [instance: 68f6afb1-87f5-4467-bbdf-b4ce1489541e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='868612cf-c9fa-4d70-ac82-3dbc48d8be17',volume_size=None,volume_type=None)] {{(pid=118886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 03:21:45.715333 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-2250c4f8-a70a-4df3-b7ae-aa364013444b tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.008626 Oct 17 03:21:45.716305 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 503/969] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 03:21:44 2022] POST /compute/v2.1/servers => generated 405 bytes in 1010 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 03:21:45.725052 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG dbcounter [-] [118887] Writing DB stats nova_cell0:SELECT=4 {{(pid=118887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:21:45.726258 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG dbcounter [-] [118887] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=118887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:21:45.730577 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-0ff9d91e-2114-4372-bc83-6ce4dff3720a tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:21:45.731905 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-0ff9d91e-2114-4372-bc83-6ce4dff3720a tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] [instance: 68f6afb1-87f5-4467-bbdf-b4ce1489541e] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:21:45.898790 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-0ff9d91e-2114-4372-bc83-6ce4dff3720a tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2969d23a676c4b7fb6c7b611c5999fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a92b100ac14d44aff5e4083a49f5ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:21:45.905762 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-0ff9d91e-2114-4372-bc83-6ce4dff3720a tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] 10.222.0.27 "GET /compute/v2.1/servers/68f6afb1-87f5-4467-bbdf-b4ce1489541e" status: 200 len: 1087 microversion: 2.1 time: 0.182623 Oct 17 03:21:45.906713 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 467/970] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:21:45 2022] GET /compute/v2.1/servers/68f6afb1-87f5-4467-bbdf-b4ce1489541e => generated 1087 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:21:46.930656 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-dd6f6a2a-c178-4ed7-9ccf-3cc1a29ec732 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:21:46.931336 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-dd6f6a2a-c178-4ed7-9ccf-3cc1a29ec732 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] [instance: 68f6afb1-87f5-4467-bbdf-b4ce1489541e] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:21:46.937682 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-dd6f6a2a-c178-4ed7-9ccf-3cc1a29ec732 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:21:46.938166 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-dd6f6a2a-c178-4ed7-9ccf-3cc1a29ec732 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:21:46.938605 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-dd6f6a2a-c178-4ed7-9ccf-3cc1a29ec732 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:21:46.939381 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-dd6f6a2a-c178-4ed7-9ccf-3cc1a29ec732 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:21:46.940009 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-dd6f6a2a-c178-4ed7-9ccf-3cc1a29ec732 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:21:46.940506 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-dd6f6a2a-c178-4ed7-9ccf-3cc1a29ec732 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:21:47.008677 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-dd6f6a2a-c178-4ed7-9ccf-3cc1a29ec732 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2969d23a676c4b7fb6c7b611c5999fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a92b100ac14d44aff5e4083a49f5ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:21:47.016423 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-dd6f6a2a-c178-4ed7-9ccf-3cc1a29ec732 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] 10.222.0.27 "GET /compute/v2.1/servers/68f6afb1-87f5-4467-bbdf-b4ce1489541e" status: 200 len: 1203 microversion: 2.1 time: 0.090378 Oct 17 03:21:47.017242 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 504/971] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:21:46 2022] GET /compute/v2.1/servers/68f6afb1-87f5-4467-bbdf-b4ce1489541e => generated 1203 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:21:48.040662 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-0fbc45f4-04f7-439c-8ffd-bd6a1358aaf1 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:21:48.041645 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-0fbc45f4-04f7-439c-8ffd-bd6a1358aaf1 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] [instance: 68f6afb1-87f5-4467-bbdf-b4ce1489541e] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:21:48.048685 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-0fbc45f4-04f7-439c-8ffd-bd6a1358aaf1 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:21:48.049163 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-0fbc45f4-04f7-439c-8ffd-bd6a1358aaf1 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:21:48.049588 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-0fbc45f4-04f7-439c-8ffd-bd6a1358aaf1 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:21:48.050283 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-0fbc45f4-04f7-439c-8ffd-bd6a1358aaf1 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:21:48.050759 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-0fbc45f4-04f7-439c-8ffd-bd6a1358aaf1 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:21:48.051200 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-0fbc45f4-04f7-439c-8ffd-bd6a1358aaf1 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:21:48.244390 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-0fbc45f4-04f7-439c-8ffd-bd6a1358aaf1 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2969d23a676c4b7fb6c7b611c5999fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a92b100ac14d44aff5e4083a49f5ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:21:48.251988 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-0fbc45f4-04f7-439c-8ffd-bd6a1358aaf1 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] 10.222.0.27 "GET /compute/v2.1/servers/68f6afb1-87f5-4467-bbdf-b4ce1489541e" status: 200 len: 1258 microversion: 2.1 time: 0.215386 Oct 17 03:21:48.252535 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 468/972] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:21:48 2022] GET /compute/v2.1/servers/68f6afb1-87f5-4467-bbdf-b4ce1489541e => generated 1258 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:21:48.321953 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [req-8d995f06-03ae-462c-a249-cd587b0005bb req-3463c2b2-c3b5-4e41-bf06-90b0c1ee0f4b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68f6afb1-87f5-4467-bbdf-b4ce1489541e", "tag": "48ec48fa-0118-49a2-bc96-50aad08e84df"}]} {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:21:48.334183 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [req-8d995f06-03ae-462c-a249-cd587b0005bb req-3463c2b2-c3b5-4e41-bf06-90b0c1ee0f4b service nova] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:21:48.334776 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [req-8d995f06-03ae-462c-a249-cd587b0005bb req-3463c2b2-c3b5-4e41-bf06-90b0c1ee0f4b service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:21:48.335298 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [req-8d995f06-03ae-462c-a249-cd587b0005bb req-3463c2b2-c3b5-4e41-bf06-90b0c1ee0f4b service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:21:48.346896 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.compute.server_external_events [req-8d995f06-03ae-462c-a249-cd587b0005bb req-3463c2b2-c3b5-4e41-bf06-90b0c1ee0f4b service nova] Creating event network-changed:48ec48fa-0118-49a2-bc96-50aad08e84df for instance 68f6afb1-87f5-4467-bbdf-b4ce1489541e on hv-cinder-84697 Oct 17 03:21:48.352663 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [req-8d995f06-03ae-462c-a249-cd587b0005bb req-3463c2b2-c3b5-4e41-bf06-90b0c1ee0f4b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035073 Oct 17 03:21:48.353255 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 505/973] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 03:21:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 03:21:49.276536 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-1c404507-2b27-476b-89e4-7c5024902bc2 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:21:49.277211 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-1c404507-2b27-476b-89e4-7c5024902bc2 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] [instance: 68f6afb1-87f5-4467-bbdf-b4ce1489541e] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:21:49.283973 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-1c404507-2b27-476b-89e4-7c5024902bc2 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:21:49.284461 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-1c404507-2b27-476b-89e4-7c5024902bc2 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:21:49.284898 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-1c404507-2b27-476b-89e4-7c5024902bc2 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:21:49.285598 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-1c404507-2b27-476b-89e4-7c5024902bc2 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:21:49.286053 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-1c404507-2b27-476b-89e4-7c5024902bc2 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:21:49.286477 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-1c404507-2b27-476b-89e4-7c5024902bc2 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:21:49.519960 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-1c404507-2b27-476b-89e4-7c5024902bc2 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2969d23a676c4b7fb6c7b611c5999fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a92b100ac14d44aff5e4083a49f5ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:21:49.528498 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-1c404507-2b27-476b-89e4-7c5024902bc2 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] 10.222.0.27 "GET /compute/v2.1/servers/68f6afb1-87f5-4467-bbdf-b4ce1489541e" status: 200 len: 1258 microversion: 2.1 time: 0.255989 Oct 17 03:21:49.529059 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 469/974] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:21:49 2022] GET /compute/v2.1/servers/68f6afb1-87f5-4467-bbdf-b4ce1489541e => generated 1258 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:21:50.552977 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-2e0926f9-9f85-4be1-adde-c2b86332e99c tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:21:50.553679 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-2e0926f9-9f85-4be1-adde-c2b86332e99c tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] [instance: 68f6afb1-87f5-4467-bbdf-b4ce1489541e] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:21:50.559840 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-2e0926f9-9f85-4be1-adde-c2b86332e99c tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:21:50.560316 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-2e0926f9-9f85-4be1-adde-c2b86332e99c tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:21:50.560745 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-2e0926f9-9f85-4be1-adde-c2b86332e99c tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:21:50.561456 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-2e0926f9-9f85-4be1-adde-c2b86332e99c tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:21:50.561908 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-2e0926f9-9f85-4be1-adde-c2b86332e99c tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:21:50.562327 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-2e0926f9-9f85-4be1-adde-c2b86332e99c tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:21:50.691668 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-2e0926f9-9f85-4be1-adde-c2b86332e99c tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2969d23a676c4b7fb6c7b611c5999fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a92b100ac14d44aff5e4083a49f5ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:21:50.699737 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-2e0926f9-9f85-4be1-adde-c2b86332e99c tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] 10.222.0.27 "GET /compute/v2.1/servers/68f6afb1-87f5-4467-bbdf-b4ce1489541e" status: 200 len: 1258 microversion: 2.1 time: 0.151938 Oct 17 03:21:50.700303 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 506/975] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:21:50 2022] GET /compute/v2.1/servers/68f6afb1-87f5-4467-bbdf-b4ce1489541e => generated 1258 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:21:51.721455 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-5ff482f5-60cc-4261-8739-3594fa36acd4 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:21:51.722080 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-5ff482f5-60cc-4261-8739-3594fa36acd4 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] [instance: 68f6afb1-87f5-4467-bbdf-b4ce1489541e] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:21:51.730020 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-5ff482f5-60cc-4261-8739-3594fa36acd4 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:21:51.730501 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-5ff482f5-60cc-4261-8739-3594fa36acd4 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:21:51.730947 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-5ff482f5-60cc-4261-8739-3594fa36acd4 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:21:51.731632 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-5ff482f5-60cc-4261-8739-3594fa36acd4 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:21:51.732080 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-5ff482f5-60cc-4261-8739-3594fa36acd4 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:21:51.732501 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-5ff482f5-60cc-4261-8739-3594fa36acd4 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:21:51.860285 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-5ff482f5-60cc-4261-8739-3594fa36acd4 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2969d23a676c4b7fb6c7b611c5999fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a92b100ac14d44aff5e4083a49f5ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:21:51.868329 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-5ff482f5-60cc-4261-8739-3594fa36acd4 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] 10.222.0.27 "GET /compute/v2.1/servers/68f6afb1-87f5-4467-bbdf-b4ce1489541e" status: 200 len: 1258 microversion: 2.1 time: 0.150690 Oct 17 03:21:51.868893 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 470/976] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:21:51 2022] GET /compute/v2.1/servers/68f6afb1-87f5-4467-bbdf-b4ce1489541e => generated 1258 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:21:52.890740 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-8acbeff5-cc82-43ce-ac61-e6f495b5fbb7 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:21:52.891380 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-8acbeff5-cc82-43ce-ac61-e6f495b5fbb7 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] [instance: 68f6afb1-87f5-4467-bbdf-b4ce1489541e] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:21:52.898830 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-8acbeff5-cc82-43ce-ac61-e6f495b5fbb7 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:21:52.899357 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-8acbeff5-cc82-43ce-ac61-e6f495b5fbb7 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:21:52.899788 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-8acbeff5-cc82-43ce-ac61-e6f495b5fbb7 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:21:52.900484 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-8acbeff5-cc82-43ce-ac61-e6f495b5fbb7 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:21:52.900934 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-8acbeff5-cc82-43ce-ac61-e6f495b5fbb7 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:21:52.901363 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-8acbeff5-cc82-43ce-ac61-e6f495b5fbb7 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:21:53.041760 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-8acbeff5-cc82-43ce-ac61-e6f495b5fbb7 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2969d23a676c4b7fb6c7b611c5999fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a92b100ac14d44aff5e4083a49f5ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:21:53.049388 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-8acbeff5-cc82-43ce-ac61-e6f495b5fbb7 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] 10.222.0.27 "GET /compute/v2.1/servers/68f6afb1-87f5-4467-bbdf-b4ce1489541e" status: 200 len: 1258 microversion: 2.1 time: 0.162519 Oct 17 03:21:53.049963 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 507/977] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:21:52 2022] GET /compute/v2.1/servers/68f6afb1-87f5-4467-bbdf-b4ce1489541e => generated 1258 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:21:54.072705 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-0eedbe05-8a26-4c51-8330-c411cd32cbbf tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:21:54.073287 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-0eedbe05-8a26-4c51-8330-c411cd32cbbf tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] [instance: 68f6afb1-87f5-4467-bbdf-b4ce1489541e] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:21:54.079590 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-0eedbe05-8a26-4c51-8330-c411cd32cbbf tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:21:54.080065 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-0eedbe05-8a26-4c51-8330-c411cd32cbbf tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:21:54.080516 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-0eedbe05-8a26-4c51-8330-c411cd32cbbf tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:21:54.081192 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-0eedbe05-8a26-4c51-8330-c411cd32cbbf tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:21:54.081637 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-0eedbe05-8a26-4c51-8330-c411cd32cbbf tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:21:54.082053 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-0eedbe05-8a26-4c51-8330-c411cd32cbbf tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:21:54.208551 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-0eedbe05-8a26-4c51-8330-c411cd32cbbf tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2969d23a676c4b7fb6c7b611c5999fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a92b100ac14d44aff5e4083a49f5ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:21:54.216163 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-0eedbe05-8a26-4c51-8330-c411cd32cbbf tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] 10.222.0.27 "GET /compute/v2.1/servers/68f6afb1-87f5-4467-bbdf-b4ce1489541e" status: 200 len: 1258 microversion: 2.1 time: 0.147302 Oct 17 03:21:54.216712 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 471/978] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:21:54 2022] GET /compute/v2.1/servers/68f6afb1-87f5-4467-bbdf-b4ce1489541e => generated 1258 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:21:55.238920 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-8b0f1585-c5aa-4d52-84f6-7bf59776df4e tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:21:55.240183 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-8b0f1585-c5aa-4d52-84f6-7bf59776df4e tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] [instance: 68f6afb1-87f5-4467-bbdf-b4ce1489541e] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:21:55.246748 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-8b0f1585-c5aa-4d52-84f6-7bf59776df4e tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:21:55.247262 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-8b0f1585-c5aa-4d52-84f6-7bf59776df4e tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:21:55.247689 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-8b0f1585-c5aa-4d52-84f6-7bf59776df4e tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:21:55.248371 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-8b0f1585-c5aa-4d52-84f6-7bf59776df4e tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:21:55.248813 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-8b0f1585-c5aa-4d52-84f6-7bf59776df4e tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:21:55.249230 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-8b0f1585-c5aa-4d52-84f6-7bf59776df4e tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:21:55.379188 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-8b0f1585-c5aa-4d52-84f6-7bf59776df4e tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2969d23a676c4b7fb6c7b611c5999fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a92b100ac14d44aff5e4083a49f5ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:21:55.387031 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-8b0f1585-c5aa-4d52-84f6-7bf59776df4e tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] 10.222.0.27 "GET /compute/v2.1/servers/68f6afb1-87f5-4467-bbdf-b4ce1489541e" status: 200 len: 1258 microversion: 2.1 time: 0.151962 Oct 17 03:21:55.387592 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 508/979] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:21:55 2022] GET /compute/v2.1/servers/68f6afb1-87f5-4467-bbdf-b4ce1489541e => generated 1258 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:21:56.409753 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-a7bbcd66-dbf6-419d-998c-62aebe7f3f6d tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:21:56.410365 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-a7bbcd66-dbf6-419d-998c-62aebe7f3f6d tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] [instance: 68f6afb1-87f5-4467-bbdf-b4ce1489541e] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:21:56.412981 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG dbcounter [-] [118887] Writing DB stats nova_cell0:SELECT=2 {{(pid=118887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:21:56.418803 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-a7bbcd66-dbf6-419d-998c-62aebe7f3f6d tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:21:56.419345 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-a7bbcd66-dbf6-419d-998c-62aebe7f3f6d tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:21:56.419784 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-a7bbcd66-dbf6-419d-998c-62aebe7f3f6d tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:21:56.420490 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-a7bbcd66-dbf6-419d-998c-62aebe7f3f6d tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:21:56.420946 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-a7bbcd66-dbf6-419d-998c-62aebe7f3f6d tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:21:56.421373 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-a7bbcd66-dbf6-419d-998c-62aebe7f3f6d tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:21:56.554968 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-a7bbcd66-dbf6-419d-998c-62aebe7f3f6d tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2969d23a676c4b7fb6c7b611c5999fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a92b100ac14d44aff5e4083a49f5ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:21:56.562611 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-a7bbcd66-dbf6-419d-998c-62aebe7f3f6d tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] 10.222.0.27 "GET /compute/v2.1/servers/68f6afb1-87f5-4467-bbdf-b4ce1489541e" status: 200 len: 1258 microversion: 2.1 time: 0.156886 Oct 17 03:21:56.563206 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 472/980] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:21:56 2022] GET /compute/v2.1/servers/68f6afb1-87f5-4467-bbdf-b4ce1489541e => generated 1258 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:21:57.586446 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-156d7c47-1089-424c-b014-090ecf4de5b6 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:21:57.587083 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-156d7c47-1089-424c-b014-090ecf4de5b6 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] [instance: 68f6afb1-87f5-4467-bbdf-b4ce1489541e] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:21:57.589004 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG dbcounter [-] [118886] Writing DB stats nova_cell0:SELECT=2 {{(pid=118886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:21:57.589658 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG dbcounter [-] [118886] Writing DB stats nova_cell0:SELECT=6 {{(pid=118886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:21:57.595994 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-156d7c47-1089-424c-b014-090ecf4de5b6 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:21:57.596471 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-156d7c47-1089-424c-b014-090ecf4de5b6 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:21:57.596899 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-156d7c47-1089-424c-b014-090ecf4de5b6 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:21:57.597585 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-156d7c47-1089-424c-b014-090ecf4de5b6 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:21:57.598034 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-156d7c47-1089-424c-b014-090ecf4de5b6 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:21:57.598454 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-156d7c47-1089-424c-b014-090ecf4de5b6 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:21:57.729800 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-156d7c47-1089-424c-b014-090ecf4de5b6 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2969d23a676c4b7fb6c7b611c5999fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a92b100ac14d44aff5e4083a49f5ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:21:57.737475 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-156d7c47-1089-424c-b014-090ecf4de5b6 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] 10.222.0.27 "GET /compute/v2.1/servers/68f6afb1-87f5-4467-bbdf-b4ce1489541e" status: 200 len: 1258 microversion: 2.1 time: 0.155809 Oct 17 03:21:57.738032 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 509/981] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:21:57 2022] GET /compute/v2.1/servers/68f6afb1-87f5-4467-bbdf-b4ce1489541e => generated 1258 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:21:58.405481 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [req-7f2dbade-0e7d-473a-ac27-bf2f5df1f950 req-f286f6d8-e4af-43ba-813f-484d28706d3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68f6afb1-87f5-4467-bbdf-b4ce1489541e", "name": "network-vif-plugged", "status": "completed", "tag": "48ec48fa-0118-49a2-bc96-50aad08e84df"}]} {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:21:58.420183 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [req-7f2dbade-0e7d-473a-ac27-bf2f5df1f950 req-f286f6d8-e4af-43ba-813f-484d28706d3c service nova] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:21:58.420661 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [req-7f2dbade-0e7d-473a-ac27-bf2f5df1f950 req-f286f6d8-e4af-43ba-813f-484d28706d3c service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:21:58.421090 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [req-7f2dbade-0e7d-473a-ac27-bf2f5df1f950 req-f286f6d8-e4af-43ba-813f-484d28706d3c service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:21:58.432782 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.compute.server_external_events [req-7f2dbade-0e7d-473a-ac27-bf2f5df1f950 req-f286f6d8-e4af-43ba-813f-484d28706d3c service nova] Creating event network-vif-plugged:48ec48fa-0118-49a2-bc96-50aad08e84df for instance 68f6afb1-87f5-4467-bbdf-b4ce1489541e on hv-cinder-84697 Oct 17 03:21:58.437947 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [req-7f2dbade-0e7d-473a-ac27-bf2f5df1f950 req-f286f6d8-e4af-43ba-813f-484d28706d3c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038147 Oct 17 03:21:58.438534 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 473/982] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 03:21:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 03:21:58.760404 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-45e81283-36e1-423f-924b-f5fa79738c3b tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:21:58.761006 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-45e81283-36e1-423f-924b-f5fa79738c3b tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] [instance: 68f6afb1-87f5-4467-bbdf-b4ce1489541e] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:21:58.767345 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-45e81283-36e1-423f-924b-f5fa79738c3b tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:21:58.767817 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-45e81283-36e1-423f-924b-f5fa79738c3b tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:21:58.768241 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-45e81283-36e1-423f-924b-f5fa79738c3b tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:21:58.768918 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-45e81283-36e1-423f-924b-f5fa79738c3b tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:21:58.769362 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-45e81283-36e1-423f-924b-f5fa79738c3b tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:21:58.769776 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-45e81283-36e1-423f-924b-f5fa79738c3b tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:21:58.898321 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-45e81283-36e1-423f-924b-f5fa79738c3b tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2969d23a676c4b7fb6c7b611c5999fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a92b100ac14d44aff5e4083a49f5ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:21:58.905913 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-45e81283-36e1-423f-924b-f5fa79738c3b tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] 10.222.0.27 "GET /compute/v2.1/servers/68f6afb1-87f5-4467-bbdf-b4ce1489541e" status: 200 len: 1258 microversion: 2.1 time: 0.149327 Oct 17 03:21:58.906465 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 510/983] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:21:58 2022] GET /compute/v2.1/servers/68f6afb1-87f5-4467-bbdf-b4ce1489541e => generated 1258 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:21:59.929792 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-49285e3d-4af7-4f9c-af71-a4e12ed5d624 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:21:59.930478 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-49285e3d-4af7-4f9c-af71-a4e12ed5d624 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] [instance: 68f6afb1-87f5-4467-bbdf-b4ce1489541e] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:21:59.937065 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-49285e3d-4af7-4f9c-af71-a4e12ed5d624 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:21:59.937540 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-49285e3d-4af7-4f9c-af71-a4e12ed5d624 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:21:59.937968 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-49285e3d-4af7-4f9c-af71-a4e12ed5d624 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:21:59.938646 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-49285e3d-4af7-4f9c-af71-a4e12ed5d624 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:21:59.939127 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-49285e3d-4af7-4f9c-af71-a4e12ed5d624 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:21:59.939541 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-49285e3d-4af7-4f9c-af71-a4e12ed5d624 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:22:00.072346 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-49285e3d-4af7-4f9c-af71-a4e12ed5d624 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2969d23a676c4b7fb6c7b611c5999fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a92b100ac14d44aff5e4083a49f5ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:22:00.079987 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-49285e3d-4af7-4f9c-af71-a4e12ed5d624 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] 10.222.0.27 "GET /compute/v2.1/servers/68f6afb1-87f5-4467-bbdf-b4ce1489541e" status: 200 len: 1442 microversion: 2.1 time: 0.154505 Oct 17 03:22:00.080544 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 474/984] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:21:59 2022] GET /compute/v2.1/servers/68f6afb1-87f5-4467-bbdf-b4ce1489541e => generated 1442 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:22:00.102563 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-4dbb31ee-3f8f-4a4b-8664-eb9f5149ad45 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:22:00.103219 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-4dbb31ee-3f8f-4a4b-8664-eb9f5149ad45 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] [instance: 68f6afb1-87f5-4467-bbdf-b4ce1489541e] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:22:00.109839 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-4dbb31ee-3f8f-4a4b-8664-eb9f5149ad45 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:22:00.110325 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-4dbb31ee-3f8f-4a4b-8664-eb9f5149ad45 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:22:00.110758 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-4dbb31ee-3f8f-4a4b-8664-eb9f5149ad45 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:22:00.115085 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-4dbb31ee-3f8f-4a4b-8664-eb9f5149ad45 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:22:00.115584 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-4dbb31ee-3f8f-4a4b-8664-eb9f5149ad45 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:22:00.116015 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-4dbb31ee-3f8f-4a4b-8664-eb9f5149ad45 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:22:00.249795 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-4dbb31ee-3f8f-4a4b-8664-eb9f5149ad45 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2969d23a676c4b7fb6c7b611c5999fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a92b100ac14d44aff5e4083a49f5ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:22:00.258238 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-4dbb31ee-3f8f-4a4b-8664-eb9f5149ad45 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] 10.222.0.27 "GET /compute/v2.1/servers/68f6afb1-87f5-4467-bbdf-b4ce1489541e" status: 200 len: 1442 microversion: 2.1 time: 0.160453 Oct 17 03:22:00.258797 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 511/985] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:22:00 2022] GET /compute/v2.1/servers/68f6afb1-87f5-4467-bbdf-b4ce1489541e => generated 1442 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:22:02.113823 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [req-ce112902-30f3-4346-9bd9-a1428faa3708 req-a132c558-9cf1-4679-b595-69356d777523 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68f6afb1-87f5-4467-bbdf-b4ce1489541e", "tag": "48ec48fa-0118-49a2-bc96-50aad08e84df"}]} {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:22:02.125550 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [req-ce112902-30f3-4346-9bd9-a1428faa3708 req-a132c558-9cf1-4679-b595-69356d777523 service nova] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:22:02.126038 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [req-ce112902-30f3-4346-9bd9-a1428faa3708 req-a132c558-9cf1-4679-b595-69356d777523 service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:22:02.126464 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [req-ce112902-30f3-4346-9bd9-a1428faa3708 req-a132c558-9cf1-4679-b595-69356d777523 service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:22:02.137321 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.compute.server_external_events [req-ce112902-30f3-4346-9bd9-a1428faa3708 req-a132c558-9cf1-4679-b595-69356d777523 service nova] Creating event network-changed:48ec48fa-0118-49a2-bc96-50aad08e84df for instance 68f6afb1-87f5-4467-bbdf-b4ce1489541e on hv-cinder-84697 Oct 17 03:22:02.142265 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [req-ce112902-30f3-4346-9bd9-a1428faa3708 req-a132c558-9cf1-4679-b595-69356d777523 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032125 Oct 17 03:22:02.142908 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 475/986] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 03:22:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:22:36.612312 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-d460df59-f15e-427a-a049-779c16c31d99 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:22:36.612893 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-d460df59-f15e-427a-a049-779c16c31d99 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] [instance: 80dda8a9-370d-4ebe-9d60-26a482c38a14] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:22:36.615184 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG dbcounter [-] [118886] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=118886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:22:36.615822 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG dbcounter [-] [118886] Writing DB stats nova_cell1:SELECT=46 {{(pid=118886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:22:36.622573 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-d460df59-f15e-427a-a049-779c16c31d99 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:22:36.623081 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-d460df59-f15e-427a-a049-779c16c31d99 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:22:36.623510 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-d460df59-f15e-427a-a049-779c16c31d99 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:22:36.624194 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-d460df59-f15e-427a-a049-779c16c31d99 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:22:36.624641 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-d460df59-f15e-427a-a049-779c16c31d99 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:22:36.625062 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-d460df59-f15e-427a-a049-779c16c31d99 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:22:36.651259 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-d460df59-f15e-427a-a049-779c16c31d99 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] [instance: 80dda8a9-370d-4ebe-9d60-26a482c38a14] Going to try to terminate instance {{(pid=118886) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 03:22:36.732500 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-d460df59-f15e-427a-a049-779c16c31d99 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] 10.222.0.27 "DELETE /compute/v2.1/servers/80dda8a9-370d-4ebe-9d60-26a482c38a14" status: 204 len: 0 microversion: 2.1 time: 0.123572 Oct 17 03:22:36.733303 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 512/987] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 03:22:36 2022] DELETE /compute/v2.1/servers/80dda8a9-370d-4ebe-9d60-26a482c38a14 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 03:22:36.740652 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG dbcounter [-] [118887] Writing DB stats nova_api:SELECT=20 {{(pid=118887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:22:36.741904 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG dbcounter [-] [118887] Writing DB stats nova_cell1:SELECT=40 {{(pid=118887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:22:36.745778 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-bc1b875b-affc-40c9-8e3d-1584f18348b9 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:22:36.746498 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-bc1b875b-affc-40c9-8e3d-1584f18348b9 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] [instance: 80dda8a9-370d-4ebe-9d60-26a482c38a14] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:22:36.753521 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-bc1b875b-affc-40c9-8e3d-1584f18348b9 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:22:36.754000 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-bc1b875b-affc-40c9-8e3d-1584f18348b9 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:22:36.754941 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-bc1b875b-affc-40c9-8e3d-1584f18348b9 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:22:36.756120 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-bc1b875b-affc-40c9-8e3d-1584f18348b9 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:22:36.756579 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-bc1b875b-affc-40c9-8e3d-1584f18348b9 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:22:36.757006 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-bc1b875b-affc-40c9-8e3d-1584f18348b9 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:22:36.890930 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-bc1b875b-affc-40c9-8e3d-1584f18348b9 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30a0379df643ff81e1ca01f3e26d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '917f1029c33f4607b398287532f2fb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:22:36.899281 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-bc1b875b-affc-40c9-8e3d-1584f18348b9 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] 10.222.0.27 "GET /compute/v2.1/servers/80dda8a9-370d-4ebe-9d60-26a482c38a14" status: 200 len: 1578 microversion: 2.1 time: 0.161412 Oct 17 03:22:36.899844 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 476/988] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:22:36 2022] GET /compute/v2.1/servers/80dda8a9-370d-4ebe-9d60-26a482c38a14 => generated 1578 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:22:37.922756 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-aca80b71-a6af-4e16-8490-82c33b2335f6 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:22:37.923490 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-aca80b71-a6af-4e16-8490-82c33b2335f6 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] [instance: 80dda8a9-370d-4ebe-9d60-26a482c38a14] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:22:37.930579 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-aca80b71-a6af-4e16-8490-82c33b2335f6 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:22:37.931110 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-aca80b71-a6af-4e16-8490-82c33b2335f6 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:22:37.931579 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-aca80b71-a6af-4e16-8490-82c33b2335f6 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:22:37.932280 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-aca80b71-a6af-4e16-8490-82c33b2335f6 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:22:37.932736 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-aca80b71-a6af-4e16-8490-82c33b2335f6 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:22:37.933164 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-aca80b71-a6af-4e16-8490-82c33b2335f6 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:22:38.066585 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-aca80b71-a6af-4e16-8490-82c33b2335f6 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30a0379df643ff81e1ca01f3e26d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '917f1029c33f4607b398287532f2fb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:22:38.074711 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-aca80b71-a6af-4e16-8490-82c33b2335f6 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] 10.222.0.27 "GET /compute/v2.1/servers/80dda8a9-370d-4ebe-9d60-26a482c38a14" status: 200 len: 1578 microversion: 2.1 time: 0.156197 Oct 17 03:22:38.075316 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 513/989] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:22:37 2022] GET /compute/v2.1/servers/80dda8a9-370d-4ebe-9d60-26a482c38a14 => generated 1578 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:22:39.099148 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-5a10881d-6f7b-4ec3-8a85-b8ba96227cb2 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:22:39.100033 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-5a10881d-6f7b-4ec3-8a85-b8ba96227cb2 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] [instance: 80dda8a9-370d-4ebe-9d60-26a482c38a14] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:22:39.106334 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-5a10881d-6f7b-4ec3-8a85-b8ba96227cb2 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:22:39.106815 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-5a10881d-6f7b-4ec3-8a85-b8ba96227cb2 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:22:39.107268 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-5a10881d-6f7b-4ec3-8a85-b8ba96227cb2 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:22:39.107963 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-5a10881d-6f7b-4ec3-8a85-b8ba96227cb2 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:22:39.108416 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-5a10881d-6f7b-4ec3-8a85-b8ba96227cb2 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:22:39.108843 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-5a10881d-6f7b-4ec3-8a85-b8ba96227cb2 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:22:39.180649 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-5a10881d-6f7b-4ec3-8a85-b8ba96227cb2 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30a0379df643ff81e1ca01f3e26d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '917f1029c33f4607b398287532f2fb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:22:39.188423 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-5a10881d-6f7b-4ec3-8a85-b8ba96227cb2 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] 10.222.0.27 "GET /compute/v2.1/servers/80dda8a9-370d-4ebe-9d60-26a482c38a14" status: 200 len: 1510 microversion: 2.1 time: 0.094625 Oct 17 03:22:39.189004 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 477/990] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:22:39 2022] GET /compute/v2.1/servers/80dda8a9-370d-4ebe-9d60-26a482c38a14 => generated 1510 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:22:39.349672 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [req-d56b0966-dbee-45a9-bb5e-642f03565f91 req-291f784c-160b-45ce-9a02-5fd75347a6e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80dda8a9-370d-4ebe-9d60-26a482c38a14", "name": "network-vif-deleted", "tag": "eae0ee63-abc6-4231-af35-475536e08de6"}]} {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:22:39.359592 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [req-d56b0966-dbee-45a9-bb5e-642f03565f91 req-291f784c-160b-45ce-9a02-5fd75347a6e3 service nova] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:22:39.360182 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [req-d56b0966-dbee-45a9-bb5e-642f03565f91 req-291f784c-160b-45ce-9a02-5fd75347a6e3 service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:22:39.360676 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [req-d56b0966-dbee-45a9-bb5e-642f03565f91 req-291f784c-160b-45ce-9a02-5fd75347a6e3 service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:22:39.372658 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.compute.server_external_events [req-d56b0966-dbee-45a9-bb5e-642f03565f91 req-291f784c-160b-45ce-9a02-5fd75347a6e3 service nova] Creating event network-vif-deleted:eae0ee63-abc6-4231-af35-475536e08de6 for instance 80dda8a9-370d-4ebe-9d60-26a482c38a14 on hv-cinder-84697 Oct 17 03:22:39.377845 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [req-d56b0966-dbee-45a9-bb5e-642f03565f91 req-291f784c-160b-45ce-9a02-5fd75347a6e3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129552 Oct 17 03:22:39.378905 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 514/991] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 03:22:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:22:40.214162 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-a7c23c71-33fb-4dd4-af44-ea9b38d2905d tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:22:40.215315 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-a7c23c71-33fb-4dd4-af44-ea9b38d2905d tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] [instance: 80dda8a9-370d-4ebe-9d60-26a482c38a14] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:22:40.221708 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-a7c23c71-33fb-4dd4-af44-ea9b38d2905d tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:22:40.222200 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-a7c23c71-33fb-4dd4-af44-ea9b38d2905d tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:22:40.222644 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-a7c23c71-33fb-4dd4-af44-ea9b38d2905d tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:22:40.223440 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-a7c23c71-33fb-4dd4-af44-ea9b38d2905d tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:22:40.223914 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-a7c23c71-33fb-4dd4-af44-ea9b38d2905d tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:22:40.224365 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-a7c23c71-33fb-4dd4-af44-ea9b38d2905d tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:22:40.238898 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.wsgi [None req-a7c23c71-33fb-4dd4-af44-ea9b38d2905d tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] HTTP exception thrown: Instance 80dda8a9-370d-4ebe-9d60-26a482c38a14 could not be found. Oct 17 03:22:40.240562 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-a7c23c71-33fb-4dd4-af44-ea9b38d2905d tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Request method failure captured: Oct 17 03:22:40.240562 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: request: GET /compute/v2.1/servers/80dda8a9-370d-4ebe-9d60-26a482c38a14 HTTP/1.1 Oct 17 03:22:40.240562 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Accept: application/json Oct 17 03:22:40.240562 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Accept-Encoding: identity Oct 17 03:22:40.240562 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Connection: close Oct 17 03:22:40.240562 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Content-Length: 0 Oct 17 03:22:40.240562 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Content-Type: application/json Oct 17 03:22:40.240562 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Host: 10.222.0.27 Oct 17 03:22:40.240562 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Openstack-System-Scope: None Oct 17 03:22:40.240562 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: User-Agent: python-urllib3/1.26.12 Oct 17 03:22:40.240562 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Auth-Token: gAAAAABjTMncvfJRZ6jaqjvQEu72rGRzqOyTvCUXXOw_jwUs__RklFePBOaej_K29FXepmEa5KO-7far_lFFa-00aLqaSzEPwGH_Rq-wa-qIOahaFhEwJtL7KjAiUerIUNLXnvyTC4umer9EGyI2SilRmeR5MbTaOJvG_YCzdarJi1aQ7wlcFPI Oct 17 03:22:40.240562 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Domain-Id: None Oct 17 03:22:40.240562 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Domain-Name: None Oct 17 03:22:40.240562 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Identity-Status: Confirmed Oct 17 03:22:40.240562 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Is-Admin-Project: True Oct 17 03:22:40.240562 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Project-Domain-Id: default Oct 17 03:22:40.240562 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Project-Domain-Name: Default Oct 17 03:22:40.240562 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Project-Id: 917f1029c33f4607b398287532f2fb4b Oct 17 03:22:40.240562 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Project-Name: tempest-TestVolumeBootPattern-1752265691 Oct 17 03:22:40.240562 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Role: member,reader Oct 17 03:22:40.240562 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Roles: member,reader Oct 17 03:22:40.242257 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/917f1029c33f4607b398287532f2fb4b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/917f1029c33f4607b398287532f2fb4b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/917f1029c33f4607b398287532f2fb4b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_917f1029c33f4607b398287532f2fb4b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 17 03:22:40.242257 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Tenant: tempest-TestVolumeBootPattern-1752265691 Oct 17 03:22:40.242257 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Tenant-Id: 917f1029c33f4607b398287532f2fb4b Oct 17 03:22:40.242257 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Tenant-Name: tempest-TestVolumeBootPattern-1752265691 Oct 17 03:22:40.242257 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-User: tempest-TestVolumeBootPattern-1752265691-project Oct 17 03:22:40.242257 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-User-Domain-Id: default Oct 17 03:22:40.242257 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-User-Domain-Name: Default Oct 17 03:22:40.242257 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-User-Id: 4d30a0379df643ff81e1ca01f3e26d3d Oct 17 03:22:40.242257 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-User-Name: tempest-TestVolumeBootPattern-1752265691-project Oct 17 03:22:40.242257 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: method: > Oct 17 03:22:40.242257 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: exception: Instance 80dda8a9-370d-4ebe-9d60-26a482c38a14 could not be found. Oct 17 03:22:40.242257 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: action_args: {'id': '80dda8a9-370d-4ebe-9d60-26a482c38a14'} Oct 17 03:22:40.243502 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 03:22:40.243502 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:22:40.243502 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 03:22:40.243502 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 03:22:40.243502 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 03:22:40.243502 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 03:22:40.243502 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 03:22:40.243502 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 03:22:40.243502 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 03:22:40.243502 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 03:22:40.243502 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80dda8a9-370d-4ebe-9d60-26a482c38a14 could not be found. Oct 17 03:22:40.243502 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Oct 17 03:22:40.243502 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:22:40.243502 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Oct 17 03:22:40.243502 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:22:40.243502 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:22:40.243502 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:22:40.243502 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 03:22:40.243502 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 03:22:40.243502 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 03:22:40.245234 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 03:22:40.245234 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 03:22:40.245234 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 03:22:40.245234 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 03:22:40.245234 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 03:22:40.245234 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 03:22:40.245234 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 03:22:40.245234 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80dda8a9-370d-4ebe-9d60-26a482c38a14 could not be found. Oct 17 03:22:40.245234 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Oct 17 03:22:40.245234 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:22:40.245234 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Oct 17 03:22:40.245234 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:22:40.245234 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:22:40.245234 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:22:40.245234 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 03:22:40.245234 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 03:22:40.245234 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80dda8a9-370d-4ebe-9d60-26a482c38a14 could not be found. Oct 17 03:22:40.245234 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Oct 17 03:22:40.246910 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-a7c23c71-33fb-4dd4-af44-ea9b38d2905d tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Returning 404 to user: Instance 80dda8a9-370d-4ebe-9d60-26a482c38a14 could not be found. {{(pid=118887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 03:22:40.246910 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-a7c23c71-33fb-4dd4-af44-ea9b38d2905d tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] 10.222.0.27 "GET /compute/v2.1/servers/80dda8a9-370d-4ebe-9d60-26a482c38a14" status: 404 len: 111 microversion: 2.1 time: 0.033026 Oct 17 03:22:40.251983 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 478/992] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:22:40 2022] GET /compute/v2.1/servers/80dda8a9-370d-4ebe-9d60-26a482c38a14 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 03:22:40.342024 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-cb15b60e-c97a-43f1-a212-b5aeada6933e tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-639537331", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-153764123", "security_groups": [{"name": "tempest-secgroup-smoke-1985794598"}], "block_device_mapping_v2": [{"uuid": "4e61676f-4a94-4b65-9606-25314eda8a94", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "69ff13bb-8fa5-45c4-abfd-0eaaeb12e4cd"}]}} {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:22:40.454438 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.network.neutron [None req-cb15b60e-c97a-43f1-a212-b5aeada6933e tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] validate_networks() for [('69ff13bb-8fa5-45c4-abfd-0eaaeb12e4cd', None, None, None, None, None)] {{(pid=118886) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 03:22:40.822797 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.virt.hardware [None req-cb15b60e-c97a-43f1-a212-b5aeada6933e tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Flavor limits 0:0:0 {{(pid=118886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 03:22:40.823236 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.virt.hardware [None req-cb15b60e-c97a-43f1-a212-b5aeada6933e tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Image limits 0:0:0 {{(pid=118886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 03:22:40.823699 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.virt.hardware [None req-cb15b60e-c97a-43f1-a212-b5aeada6933e tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Flavor pref 0:0:0 {{(pid=118886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 03:22:40.824096 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.virt.hardware [None req-cb15b60e-c97a-43f1-a212-b5aeada6933e tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Image pref 0:0:0 {{(pid=118886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 03:22:40.824497 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.virt.hardware [None req-cb15b60e-c97a-43f1-a212-b5aeada6933e tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 03:22:40.833312 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-cb15b60e-c97a-43f1-a212-b5aeada6933e tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:22:40.833779 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-cb15b60e-c97a-43f1-a212-b5aeada6933e tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:22:40.834203 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-cb15b60e-c97a-43f1-a212-b5aeada6933e tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:22:40.834949 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-cb15b60e-c97a-43f1-a212-b5aeada6933e tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:22:40.835393 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-cb15b60e-c97a-43f1-a212-b5aeada6933e tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:22:40.835805 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-cb15b60e-c97a-43f1-a212-b5aeada6933e tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:22:40.852349 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.quota [None req-cb15b60e-c97a-43f1-a212-b5aeada6933e tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Getting quotas for project 917f1029c33f4607b398287532f2fb4b. Resources: {'instances', 'cores', 'ram'} {{(pid=118886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 03:22:40.856186 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.quota [None req-cb15b60e-c97a-43f1-a212-b5aeada6933e tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Getting quotas for user 4d30a0379df643ff81e1ca01f3e26d3d and project 917f1029c33f4607b398287532f2fb4b. Resources: {'instances', 'cores', 'ram'} {{(pid=118886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 03:22:40.915760 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-cb15b60e-c97a-43f1-a212-b5aeada6933e tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Going to run 1 instances... {{(pid=118886) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 03:22:40.918254 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-cb15b60e-c97a-43f1-a212-b5aeada6933e tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] [instance: 2e3f89ba-cb21-406a-bd30-004d49d589db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4e61676f-4a94-4b65-9606-25314eda8a94',volume_size=None,volume_type=None)] {{(pid=118886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 03:22:41.051143 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-cb15b60e-c97a-43f1-a212-b5aeada6933e tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.713687 Oct 17 03:22:41.052838 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 515/993] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 03:22:40 2022] POST /compute/v2.1/servers => generated 406 bytes in 716 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 03:22:41.063758 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-6edbb95f-e6ab-4464-b5fe-27676f1ca27a tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:22:41.064444 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-6edbb95f-e6ab-4464-b5fe-27676f1ca27a tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] [instance: 2e3f89ba-cb21-406a-bd30-004d49d589db] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:22:41.119117 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-6edbb95f-e6ab-4464-b5fe-27676f1ca27a tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30a0379df643ff81e1ca01f3e26d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '917f1029c33f4607b398287532f2fb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:22:41.126028 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-6edbb95f-e6ab-4464-b5fe-27676f1ca27a tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] 10.222.0.27 "GET /compute/v2.1/servers/2e3f89ba-cb21-406a-bd30-004d49d589db" status: 200 len: 1093 microversion: 2.1 time: 0.066125 Oct 17 03:22:41.126587 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 479/994] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:22:41 2022] GET /compute/v2.1/servers/2e3f89ba-cb21-406a-bd30-004d49d589db => generated 1093 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:22:42.150010 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-6d3da796-5374-4dd8-a49e-a7df466d4332 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:22:42.154013 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-6d3da796-5374-4dd8-a49e-a7df466d4332 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] [instance: 2e3f89ba-cb21-406a-bd30-004d49d589db] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:22:42.161159 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-6d3da796-5374-4dd8-a49e-a7df466d4332 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:22:42.161659 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-6d3da796-5374-4dd8-a49e-a7df466d4332 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:22:42.162085 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-6d3da796-5374-4dd8-a49e-a7df466d4332 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:22:42.162780 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-6d3da796-5374-4dd8-a49e-a7df466d4332 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:22:42.163311 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-6d3da796-5374-4dd8-a49e-a7df466d4332 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:22:42.163734 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-6d3da796-5374-4dd8-a49e-a7df466d4332 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:22:42.231330 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-6d3da796-5374-4dd8-a49e-a7df466d4332 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30a0379df643ff81e1ca01f3e26d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '917f1029c33f4607b398287532f2fb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:22:42.239725 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-6d3da796-5374-4dd8-a49e-a7df466d4332 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] 10.222.0.27 "GET /compute/v2.1/servers/2e3f89ba-cb21-406a-bd30-004d49d589db" status: 200 len: 1191 microversion: 2.1 time: 0.094132 Oct 17 03:22:42.240314 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 516/995] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:22:42 2022] GET /compute/v2.1/servers/2e3f89ba-cb21-406a-bd30-004d49d589db => generated 1191 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:22:43.263629 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-684ab813-922d-43cd-8d99-34da45234758 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:22:43.264213 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-684ab813-922d-43cd-8d99-34da45234758 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] [instance: 2e3f89ba-cb21-406a-bd30-004d49d589db] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:22:43.271513 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-684ab813-922d-43cd-8d99-34da45234758 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:22:43.271988 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-684ab813-922d-43cd-8d99-34da45234758 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:22:43.272413 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-684ab813-922d-43cd-8d99-34da45234758 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:22:43.273094 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-684ab813-922d-43cd-8d99-34da45234758 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:22:43.273539 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-684ab813-922d-43cd-8d99-34da45234758 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:22:43.273956 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-684ab813-922d-43cd-8d99-34da45234758 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:22:43.476509 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-684ab813-922d-43cd-8d99-34da45234758 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30a0379df643ff81e1ca01f3e26d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '917f1029c33f4607b398287532f2fb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:22:43.484668 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-684ab813-922d-43cd-8d99-34da45234758 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] 10.222.0.27 "GET /compute/v2.1/servers/2e3f89ba-cb21-406a-bd30-004d49d589db" status: 200 len: 1265 microversion: 2.1 time: 0.224963 Oct 17 03:22:43.485277 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 480/996] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:22:43 2022] GET /compute/v2.1/servers/2e3f89ba-cb21-406a-bd30-004d49d589db => generated 1265 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:22:43.774491 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [req-95e81926-2455-465d-a96b-b3c5c5274026 req-330e6834-dfc0-40ba-9e24-2f030a149322 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e3f89ba-cb21-406a-bd30-004d49d589db", "tag": "e329b034-354a-460c-a740-22ac7c371ccb"}]} {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:22:43.786785 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [req-95e81926-2455-465d-a96b-b3c5c5274026 req-330e6834-dfc0-40ba-9e24-2f030a149322 service nova] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:22:43.787377 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [req-95e81926-2455-465d-a96b-b3c5c5274026 req-330e6834-dfc0-40ba-9e24-2f030a149322 service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:22:43.787876 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [req-95e81926-2455-465d-a96b-b3c5c5274026 req-330e6834-dfc0-40ba-9e24-2f030a149322 service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:22:43.800003 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.compute.server_external_events [req-95e81926-2455-465d-a96b-b3c5c5274026 req-330e6834-dfc0-40ba-9e24-2f030a149322 service nova] Creating event network-changed:e329b034-354a-460c-a740-22ac7c371ccb for instance 2e3f89ba-cb21-406a-bd30-004d49d589db on hv-cinder-84697 Oct 17 03:22:43.805796 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [req-95e81926-2455-465d-a96b-b3c5c5274026 req-330e6834-dfc0-40ba-9e24-2f030a149322 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035326 Oct 17 03:22:43.806580 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 517/997] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 03:22:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:22:44.508776 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-ed8fda30-b5d3-4ac2-8f0b-39564c580a23 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:22:44.509378 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-ed8fda30-b5d3-4ac2-8f0b-39564c580a23 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] [instance: 2e3f89ba-cb21-406a-bd30-004d49d589db] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:22:44.515424 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-ed8fda30-b5d3-4ac2-8f0b-39564c580a23 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:22:44.515901 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-ed8fda30-b5d3-4ac2-8f0b-39564c580a23 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:22:44.516330 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-ed8fda30-b5d3-4ac2-8f0b-39564c580a23 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:22:44.517029 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-ed8fda30-b5d3-4ac2-8f0b-39564c580a23 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:22:44.517476 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-ed8fda30-b5d3-4ac2-8f0b-39564c580a23 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:22:44.517895 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-ed8fda30-b5d3-4ac2-8f0b-39564c580a23 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:22:44.711139 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-ed8fda30-b5d3-4ac2-8f0b-39564c580a23 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30a0379df643ff81e1ca01f3e26d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '917f1029c33f4607b398287532f2fb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:22:44.718898 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-ed8fda30-b5d3-4ac2-8f0b-39564c580a23 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] 10.222.0.27 "GET /compute/v2.1/servers/2e3f89ba-cb21-406a-bd30-004d49d589db" status: 200 len: 1265 microversion: 2.1 time: 0.214895 Oct 17 03:22:44.719472 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 481/998] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:22:44 2022] GET /compute/v2.1/servers/2e3f89ba-cb21-406a-bd30-004d49d589db => generated 1265 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:22:45.744076 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-4bc7c417-59d5-4cc5-95f7-ff513a594794 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:22:45.744769 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-4bc7c417-59d5-4cc5-95f7-ff513a594794 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] [instance: 2e3f89ba-cb21-406a-bd30-004d49d589db] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:22:45.751438 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-4bc7c417-59d5-4cc5-95f7-ff513a594794 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:22:45.751918 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-4bc7c417-59d5-4cc5-95f7-ff513a594794 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:22:45.752349 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-4bc7c417-59d5-4cc5-95f7-ff513a594794 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:22:45.753035 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-4bc7c417-59d5-4cc5-95f7-ff513a594794 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:22:45.753485 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-4bc7c417-59d5-4cc5-95f7-ff513a594794 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:22:45.753909 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-4bc7c417-59d5-4cc5-95f7-ff513a594794 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:22:45.881928 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-4bc7c417-59d5-4cc5-95f7-ff513a594794 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30a0379df643ff81e1ca01f3e26d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '917f1029c33f4607b398287532f2fb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:22:45.889523 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-4bc7c417-59d5-4cc5-95f7-ff513a594794 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] 10.222.0.27 "GET /compute/v2.1/servers/2e3f89ba-cb21-406a-bd30-004d49d589db" status: 200 len: 1265 microversion: 2.1 time: 0.150554 Oct 17 03:22:45.890093 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 518/999] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:22:45 2022] GET /compute/v2.1/servers/2e3f89ba-cb21-406a-bd30-004d49d589db => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:22:46.912538 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-cccfc48d-2023-4fed-ae22-96a477a8816c tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:22:46.913139 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-cccfc48d-2023-4fed-ae22-96a477a8816c tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] [instance: 2e3f89ba-cb21-406a-bd30-004d49d589db] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:22:46.919794 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-cccfc48d-2023-4fed-ae22-96a477a8816c tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:22:46.920270 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-cccfc48d-2023-4fed-ae22-96a477a8816c tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:22:46.920694 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-cccfc48d-2023-4fed-ae22-96a477a8816c tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:22:46.921373 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-cccfc48d-2023-4fed-ae22-96a477a8816c tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:22:46.921820 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-cccfc48d-2023-4fed-ae22-96a477a8816c tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:22:46.922236 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-cccfc48d-2023-4fed-ae22-96a477a8816c tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:22:47.057853 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-cccfc48d-2023-4fed-ae22-96a477a8816c tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30a0379df643ff81e1ca01f3e26d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '917f1029c33f4607b398287532f2fb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:22:47.065480 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-cccfc48d-2023-4fed-ae22-96a477a8816c tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] 10.222.0.27 "GET /compute/v2.1/servers/2e3f89ba-cb21-406a-bd30-004d49d589db" status: 200 len: 1265 microversion: 2.1 time: 0.157259 Oct 17 03:22:47.066040 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 482/1000] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:22:46 2022] GET /compute/v2.1/servers/2e3f89ba-cb21-406a-bd30-004d49d589db => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:22:48.087828 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-6941b0d2-fe70-4567-aa0d-3ddc182196c1 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:22:48.088433 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-6941b0d2-fe70-4567-aa0d-3ddc182196c1 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] [instance: 2e3f89ba-cb21-406a-bd30-004d49d589db] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:22:48.094884 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-6941b0d2-fe70-4567-aa0d-3ddc182196c1 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:22:48.095386 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-6941b0d2-fe70-4567-aa0d-3ddc182196c1 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:22:48.095816 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-6941b0d2-fe70-4567-aa0d-3ddc182196c1 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:22:48.096497 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-6941b0d2-fe70-4567-aa0d-3ddc182196c1 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:22:48.096944 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-6941b0d2-fe70-4567-aa0d-3ddc182196c1 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:22:48.097361 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-6941b0d2-fe70-4567-aa0d-3ddc182196c1 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:22:48.225405 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-6941b0d2-fe70-4567-aa0d-3ddc182196c1 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30a0379df643ff81e1ca01f3e26d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '917f1029c33f4607b398287532f2fb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:22:48.232974 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-6941b0d2-fe70-4567-aa0d-3ddc182196c1 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] 10.222.0.27 "GET /compute/v2.1/servers/2e3f89ba-cb21-406a-bd30-004d49d589db" status: 200 len: 1265 microversion: 2.1 time: 0.149037 Oct 17 03:22:48.233524 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 519/1001] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:22:48 2022] GET /compute/v2.1/servers/2e3f89ba-cb21-406a-bd30-004d49d589db => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:22:49.255466 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-b3e48fd7-e1d9-40ba-90b9-e75ca77924fe tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:22:49.256076 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-b3e48fd7-e1d9-40ba-90b9-e75ca77924fe tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] [instance: 2e3f89ba-cb21-406a-bd30-004d49d589db] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:22:49.262513 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-b3e48fd7-e1d9-40ba-90b9-e75ca77924fe tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:22:49.263031 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-b3e48fd7-e1d9-40ba-90b9-e75ca77924fe tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:22:49.263461 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-b3e48fd7-e1d9-40ba-90b9-e75ca77924fe tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:22:49.264143 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-b3e48fd7-e1d9-40ba-90b9-e75ca77924fe tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:22:49.264597 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-b3e48fd7-e1d9-40ba-90b9-e75ca77924fe tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:22:49.265017 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-b3e48fd7-e1d9-40ba-90b9-e75ca77924fe tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:22:49.392606 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-b3e48fd7-e1d9-40ba-90b9-e75ca77924fe tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30a0379df643ff81e1ca01f3e26d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '917f1029c33f4607b398287532f2fb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:22:49.400319 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-b3e48fd7-e1d9-40ba-90b9-e75ca77924fe tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] 10.222.0.27 "GET /compute/v2.1/servers/2e3f89ba-cb21-406a-bd30-004d49d589db" status: 200 len: 1265 microversion: 2.1 time: 0.148777 Oct 17 03:22:49.400882 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 483/1002] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:22:49 2022] GET /compute/v2.1/servers/2e3f89ba-cb21-406a-bd30-004d49d589db => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:22:50.423162 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-0301c565-d47c-45ef-baeb-2aad3e35ffbd tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:22:50.423763 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-0301c565-d47c-45ef-baeb-2aad3e35ffbd tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] [instance: 2e3f89ba-cb21-406a-bd30-004d49d589db] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:22:50.430558 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-0301c565-d47c-45ef-baeb-2aad3e35ffbd tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:22:50.431095 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-0301c565-d47c-45ef-baeb-2aad3e35ffbd tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:22:50.431528 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-0301c565-d47c-45ef-baeb-2aad3e35ffbd tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:22:50.432216 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-0301c565-d47c-45ef-baeb-2aad3e35ffbd tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:22:50.432668 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-0301c565-d47c-45ef-baeb-2aad3e35ffbd tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:22:50.433087 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-0301c565-d47c-45ef-baeb-2aad3e35ffbd tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:22:50.563506 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-0301c565-d47c-45ef-baeb-2aad3e35ffbd tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30a0379df643ff81e1ca01f3e26d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '917f1029c33f4607b398287532f2fb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:22:50.571628 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-0301c565-d47c-45ef-baeb-2aad3e35ffbd tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] 10.222.0.27 "GET /compute/v2.1/servers/2e3f89ba-cb21-406a-bd30-004d49d589db" status: 200 len: 1265 microversion: 2.1 time: 0.152328 Oct 17 03:22:50.572189 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 520/1003] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:22:50 2022] GET /compute/v2.1/servers/2e3f89ba-cb21-406a-bd30-004d49d589db => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:22:51.594188 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-f0bee05b-c538-4300-9a9d-648e7fc84da6 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:22:51.594823 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-f0bee05b-c538-4300-9a9d-648e7fc84da6 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] [instance: 2e3f89ba-cb21-406a-bd30-004d49d589db] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:22:51.597132 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG dbcounter [-] [118887] Writing DB stats nova_cell0:SELECT=2 {{(pid=118887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:22:51.602887 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-f0bee05b-c538-4300-9a9d-648e7fc84da6 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:22:51.603388 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-f0bee05b-c538-4300-9a9d-648e7fc84da6 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:22:51.603824 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-f0bee05b-c538-4300-9a9d-648e7fc84da6 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:22:51.604520 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-f0bee05b-c538-4300-9a9d-648e7fc84da6 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:22:51.604999 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-f0bee05b-c538-4300-9a9d-648e7fc84da6 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:22:51.605421 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-f0bee05b-c538-4300-9a9d-648e7fc84da6 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:22:51.736251 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-f0bee05b-c538-4300-9a9d-648e7fc84da6 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30a0379df643ff81e1ca01f3e26d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '917f1029c33f4607b398287532f2fb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:22:51.743987 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-f0bee05b-c538-4300-9a9d-648e7fc84da6 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] 10.222.0.27 "GET /compute/v2.1/servers/2e3f89ba-cb21-406a-bd30-004d49d589db" status: 200 len: 1265 microversion: 2.1 time: 0.153611 Oct 17 03:22:51.744548 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 484/1004] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:22:51 2022] GET /compute/v2.1/servers/2e3f89ba-cb21-406a-bd30-004d49d589db => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:22:52.766460 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-da8e04bb-0ade-413d-8d95-609a7005ce34 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:22:52.767703 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-da8e04bb-0ade-413d-8d95-609a7005ce34 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] [instance: 2e3f89ba-cb21-406a-bd30-004d49d589db] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:22:52.769801 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG dbcounter [-] [118886] Writing DB stats nova_cell0:SELECT=2 {{(pid=118886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:22:52.770482 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG dbcounter [-] [118886] Writing DB stats nova_cell0:SELECT=6 {{(pid=118886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:22:52.777170 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-da8e04bb-0ade-413d-8d95-609a7005ce34 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:22:52.777919 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-da8e04bb-0ade-413d-8d95-609a7005ce34 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:22:52.778078 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-da8e04bb-0ade-413d-8d95-609a7005ce34 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:22:52.778751 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-da8e04bb-0ade-413d-8d95-609a7005ce34 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:22:52.779227 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-da8e04bb-0ade-413d-8d95-609a7005ce34 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:22:52.779674 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-da8e04bb-0ade-413d-8d95-609a7005ce34 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:22:52.914633 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-da8e04bb-0ade-413d-8d95-609a7005ce34 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30a0379df643ff81e1ca01f3e26d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '917f1029c33f4607b398287532f2fb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:22:52.922518 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-da8e04bb-0ade-413d-8d95-609a7005ce34 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] 10.222.0.27 "GET /compute/v2.1/servers/2e3f89ba-cb21-406a-bd30-004d49d589db" status: 200 len: 1265 microversion: 2.1 time: 0.159863 Oct 17 03:22:52.923102 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 521/1005] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:22:52 2022] GET /compute/v2.1/servers/2e3f89ba-cb21-406a-bd30-004d49d589db => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:22:53.945428 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-27177a83-caad-4646-b7b9-7fa3617775db tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:22:53.945916 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-27177a83-caad-4646-b7b9-7fa3617775db tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] [instance: 2e3f89ba-cb21-406a-bd30-004d49d589db] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:22:53.952319 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-27177a83-caad-4646-b7b9-7fa3617775db tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:22:53.952808 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-27177a83-caad-4646-b7b9-7fa3617775db tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:22:53.953254 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-27177a83-caad-4646-b7b9-7fa3617775db tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:22:53.953953 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-27177a83-caad-4646-b7b9-7fa3617775db tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:22:53.954413 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-27177a83-caad-4646-b7b9-7fa3617775db tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:22:53.954836 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-27177a83-caad-4646-b7b9-7fa3617775db tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:22:54.160962 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-27177a83-caad-4646-b7b9-7fa3617775db tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30a0379df643ff81e1ca01f3e26d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '917f1029c33f4607b398287532f2fb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:22:54.169761 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-27177a83-caad-4646-b7b9-7fa3617775db tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] 10.222.0.27 "GET /compute/v2.1/servers/2e3f89ba-cb21-406a-bd30-004d49d589db" status: 200 len: 1265 microversion: 2.1 time: 0.228709 Oct 17 03:22:54.170341 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 485/1006] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:22:53 2022] GET /compute/v2.1/servers/2e3f89ba-cb21-406a-bd30-004d49d589db => generated 1265 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:22:54.749340 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [req-81f39b16-2bcc-4069-a4f9-ca2942136ad6 req-73c2d1ac-f1d4-4a03-a71e-87661ffb3c1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e3f89ba-cb21-406a-bd30-004d49d589db", "name": "network-vif-plugged", "status": "completed", "tag": "e329b034-354a-460c-a740-22ac7c371ccb"}]} {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:22:54.759515 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [req-81f39b16-2bcc-4069-a4f9-ca2942136ad6 req-73c2d1ac-f1d4-4a03-a71e-87661ffb3c1a service nova] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:22:54.759987 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [req-81f39b16-2bcc-4069-a4f9-ca2942136ad6 req-73c2d1ac-f1d4-4a03-a71e-87661ffb3c1a service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:22:54.760405 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [req-81f39b16-2bcc-4069-a4f9-ca2942136ad6 req-73c2d1ac-f1d4-4a03-a71e-87661ffb3c1a service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:22:54.771958 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.compute.server_external_events [req-81f39b16-2bcc-4069-a4f9-ca2942136ad6 req-73c2d1ac-f1d4-4a03-a71e-87661ffb3c1a service nova] Creating event network-vif-plugged:e329b034-354a-460c-a740-22ac7c371ccb for instance 2e3f89ba-cb21-406a-bd30-004d49d589db on hv-cinder-84697 Oct 17 03:22:54.776769 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [req-81f39b16-2bcc-4069-a4f9-ca2942136ad6 req-73c2d1ac-f1d4-4a03-a71e-87661ffb3c1a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088098 Oct 17 03:22:54.777340 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 522/1007] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 03:22:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:22:55.193016 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-4e6b9565-7453-4bd4-bcbe-442169dd1422 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:22:55.193612 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-4e6b9565-7453-4bd4-bcbe-442169dd1422 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] [instance: 2e3f89ba-cb21-406a-bd30-004d49d589db] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:22:55.199923 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-4e6b9565-7453-4bd4-bcbe-442169dd1422 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:22:55.200396 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-4e6b9565-7453-4bd4-bcbe-442169dd1422 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:22:55.200825 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-4e6b9565-7453-4bd4-bcbe-442169dd1422 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:22:55.201502 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-4e6b9565-7453-4bd4-bcbe-442169dd1422 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:22:55.201946 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-4e6b9565-7453-4bd4-bcbe-442169dd1422 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:22:55.202363 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-4e6b9565-7453-4bd4-bcbe-442169dd1422 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:22:55.330222 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-4e6b9565-7453-4bd4-bcbe-442169dd1422 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30a0379df643ff81e1ca01f3e26d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '917f1029c33f4607b398287532f2fb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:22:55.338312 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-4e6b9565-7453-4bd4-bcbe-442169dd1422 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] 10.222.0.27 "GET /compute/v2.1/servers/2e3f89ba-cb21-406a-bd30-004d49d589db" status: 200 len: 1265 microversion: 2.1 time: 0.149422 Oct 17 03:22:55.339073 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 486/1008] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:22:55 2022] GET /compute/v2.1/servers/2e3f89ba-cb21-406a-bd30-004d49d589db => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:22:56.365084 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-62630c7d-d0d1-48bc-b95d-48f79b20fa0d tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:22:56.365782 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-62630c7d-d0d1-48bc-b95d-48f79b20fa0d tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] [instance: 2e3f89ba-cb21-406a-bd30-004d49d589db] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:22:56.371898 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-62630c7d-d0d1-48bc-b95d-48f79b20fa0d tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:22:56.372376 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-62630c7d-d0d1-48bc-b95d-48f79b20fa0d tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:22:56.372807 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-62630c7d-d0d1-48bc-b95d-48f79b20fa0d tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:22:56.373492 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-62630c7d-d0d1-48bc-b95d-48f79b20fa0d tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:22:56.373942 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-62630c7d-d0d1-48bc-b95d-48f79b20fa0d tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:22:56.374365 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-62630c7d-d0d1-48bc-b95d-48f79b20fa0d tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:22:56.507429 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-62630c7d-d0d1-48bc-b95d-48f79b20fa0d tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30a0379df643ff81e1ca01f3e26d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '917f1029c33f4607b398287532f2fb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:22:56.516383 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-62630c7d-d0d1-48bc-b95d-48f79b20fa0d tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] 10.222.0.27 "GET /compute/v2.1/servers/2e3f89ba-cb21-406a-bd30-004d49d589db" status: 200 len: 1265 microversion: 2.1 time: 0.156619 Oct 17 03:22:56.517177 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 523/1009] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:22:56 2022] GET /compute/v2.1/servers/2e3f89ba-cb21-406a-bd30-004d49d589db => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:22:57.539556 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-f40a35fe-75a9-49ae-a81e-6c84d671477f tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:22:57.540095 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-f40a35fe-75a9-49ae-a81e-6c84d671477f tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] [instance: 2e3f89ba-cb21-406a-bd30-004d49d589db] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:22:57.546944 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-f40a35fe-75a9-49ae-a81e-6c84d671477f tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:22:57.547424 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-f40a35fe-75a9-49ae-a81e-6c84d671477f tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:22:57.547854 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-f40a35fe-75a9-49ae-a81e-6c84d671477f tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:22:57.548534 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-f40a35fe-75a9-49ae-a81e-6c84d671477f tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:22:57.548983 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-f40a35fe-75a9-49ae-a81e-6c84d671477f tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:22:57.549410 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-f40a35fe-75a9-49ae-a81e-6c84d671477f tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:22:57.682041 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-f40a35fe-75a9-49ae-a81e-6c84d671477f tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30a0379df643ff81e1ca01f3e26d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '917f1029c33f4607b398287532f2fb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:22:57.689725 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-f40a35fe-75a9-49ae-a81e-6c84d671477f tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] 10.222.0.27 "GET /compute/v2.1/servers/2e3f89ba-cb21-406a-bd30-004d49d589db" status: 200 len: 1453 microversion: 2.1 time: 0.154169 Oct 17 03:22:57.690282 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 487/1010] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:22:57 2022] GET /compute/v2.1/servers/2e3f89ba-cb21-406a-bd30-004d49d589db => generated 1453 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:22:57.712846 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-51a968f7-5a1a-4d68-974f-23f75b758dee tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:22:57.713450 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-51a968f7-5a1a-4d68-974f-23f75b758dee tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] [instance: 2e3f89ba-cb21-406a-bd30-004d49d589db] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:22:57.719746 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-51a968f7-5a1a-4d68-974f-23f75b758dee tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:22:57.720223 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-51a968f7-5a1a-4d68-974f-23f75b758dee tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:22:57.720651 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-51a968f7-5a1a-4d68-974f-23f75b758dee tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:22:57.721363 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-51a968f7-5a1a-4d68-974f-23f75b758dee tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:22:57.721810 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-51a968f7-5a1a-4d68-974f-23f75b758dee tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:22:57.722235 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-51a968f7-5a1a-4d68-974f-23f75b758dee tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:22:57.852514 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-51a968f7-5a1a-4d68-974f-23f75b758dee tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30a0379df643ff81e1ca01f3e26d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '917f1029c33f4607b398287532f2fb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:22:57.860184 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-51a968f7-5a1a-4d68-974f-23f75b758dee tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] 10.222.0.27 "GET /compute/v2.1/servers/2e3f89ba-cb21-406a-bd30-004d49d589db" status: 200 len: 1453 microversion: 2.1 time: 0.152040 Oct 17 03:22:57.860746 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 524/1011] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:22:57 2022] GET /compute/v2.1/servers/2e3f89ba-cb21-406a-bd30-004d49d589db => generated 1453 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:22:59.669596 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [req-1e8914ed-8636-4af6-9849-fc50ed25b12c req-2d835d09-88b2-4691-99be-63ca3b39ae76 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e3f89ba-cb21-406a-bd30-004d49d589db", "tag": "e329b034-354a-460c-a740-22ac7c371ccb"}]} {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:22:59.680111 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [req-1e8914ed-8636-4af6-9849-fc50ed25b12c req-2d835d09-88b2-4691-99be-63ca3b39ae76 service nova] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:22:59.680589 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [req-1e8914ed-8636-4af6-9849-fc50ed25b12c req-2d835d09-88b2-4691-99be-63ca3b39ae76 service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:22:59.681019 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [req-1e8914ed-8636-4af6-9849-fc50ed25b12c req-2d835d09-88b2-4691-99be-63ca3b39ae76 service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:22:59.691889 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.compute.server_external_events [req-1e8914ed-8636-4af6-9849-fc50ed25b12c req-2d835d09-88b2-4691-99be-63ca3b39ae76 service nova] Creating event network-changed:e329b034-354a-460c-a740-22ac7c371ccb for instance 2e3f89ba-cb21-406a-bd30-004d49d589db on hv-cinder-84697 Oct 17 03:22:59.697053 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [req-1e8914ed-8636-4af6-9849-fc50ed25b12c req-2d835d09-88b2-4691-99be-63ca3b39ae76 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031396 Oct 17 03:22:59.697712 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 488/1012] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 03:22:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:23:59.367660 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG dbcounter [-] [118886] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=118886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:23:59.368461 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG dbcounter [-] [118886] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:23:59.369311 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 17 03:23:59.369444 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Mon Oct 17 03:23:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/68f6afb1-87f5-4467-bbdf-b4ce1489541e/action (ip 10.222.0.27) !!! Oct 17 03:23:59.374353 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-8c9e6d2c-8d13-4197-a0a9-a7e73c918dc2 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:23:59.374925 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-8c9e6d2c-8d13-4197-a0a9-a7e73c918dc2 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] [instance: 68f6afb1-87f5-4467-bbdf-b4ce1489541e] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:23:59.383793 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-8c9e6d2c-8d13-4197-a0a9-a7e73c918dc2 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:23:59.384314 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-8c9e6d2c-8d13-4197-a0a9-a7e73c918dc2 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:23:59.384769 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-8c9e6d2c-8d13-4197-a0a9-a7e73c918dc2 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:23:59.385462 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-8c9e6d2c-8d13-4197-a0a9-a7e73c918dc2 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:23:59.385908 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-8c9e6d2c-8d13-4197-a0a9-a7e73c918dc2 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:23:59.386329 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-8c9e6d2c-8d13-4197-a0a9-a7e73c918dc2 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:23:59.411873 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.objects.instance [None req-8c9e6d2c-8d13-4197-a0a9-a7e73c918dc2 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lazy-loading 'flavor' on Instance uuid 68f6afb1-87f5-4467-bbdf-b4ce1489541e {{(pid=118886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 03:23:59.482983 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-8c9e6d2c-8d13-4197-a0a9-a7e73c918dc2 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] 10.222.0.27 "POST /compute/v2.1/servers/68f6afb1-87f5-4467-bbdf-b4ce1489541e/action" status: 202 len: 0 microversion: 2.1 time: 0.117074 Oct 17 03:23:59.483556 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 525/1013] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 03:23:59 2022] POST /compute/v2.1/servers/68f6afb1-87f5-4467-bbdf-b4ce1489541e/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 03:23:59.490377 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG dbcounter [-] [118887] Writing DB stats nova_api:SELECT=28 {{(pid=118887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:23:59.491134 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG dbcounter [-] [118887] Writing DB stats nova_cell1:SELECT=64 {{(pid=118887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:23:59.495503 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-266bb63e-1b9d-4597-8e4f-9ba73a347d9e tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:23:59.496204 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-266bb63e-1b9d-4597-8e4f-9ba73a347d9e tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] [instance: 68f6afb1-87f5-4467-bbdf-b4ce1489541e] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:23:59.505003 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-266bb63e-1b9d-4597-8e4f-9ba73a347d9e tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:23:59.505503 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-266bb63e-1b9d-4597-8e4f-9ba73a347d9e tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:23:59.505999 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-266bb63e-1b9d-4597-8e4f-9ba73a347d9e tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:23:59.506718 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-266bb63e-1b9d-4597-8e4f-9ba73a347d9e tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:23:59.507130 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-266bb63e-1b9d-4597-8e4f-9ba73a347d9e tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:23:59.507654 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-266bb63e-1b9d-4597-8e4f-9ba73a347d9e tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:23:59.637069 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-266bb63e-1b9d-4597-8e4f-9ba73a347d9e tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2969d23a676c4b7fb6c7b611c5999fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a92b100ac14d44aff5e4083a49f5ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:23:59.644776 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-266bb63e-1b9d-4597-8e4f-9ba73a347d9e tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] 10.222.0.27 "GET /compute/v2.1/servers/68f6afb1-87f5-4467-bbdf-b4ce1489541e" status: 200 len: 1566 microversion: 2.1 time: 0.156133 Oct 17 03:23:59.645333 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 489/1014] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:23:59 2022] GET /compute/v2.1/servers/68f6afb1-87f5-4467-bbdf-b4ce1489541e => generated 1566 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:24:00.670799 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-f0949f30-6813-4132-939f-a70fb7fb44e7 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:24:00.671645 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-f0949f30-6813-4132-939f-a70fb7fb44e7 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] [instance: 68f6afb1-87f5-4467-bbdf-b4ce1489541e] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:24:00.678237 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-f0949f30-6813-4132-939f-a70fb7fb44e7 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:24:00.678742 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-f0949f30-6813-4132-939f-a70fb7fb44e7 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:24:00.679214 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-f0949f30-6813-4132-939f-a70fb7fb44e7 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:24:00.679924 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-f0949f30-6813-4132-939f-a70fb7fb44e7 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:24:00.680367 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-f0949f30-6813-4132-939f-a70fb7fb44e7 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:24:00.680787 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-f0949f30-6813-4132-939f-a70fb7fb44e7 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:24:00.814709 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-f0949f30-6813-4132-939f-a70fb7fb44e7 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2969d23a676c4b7fb6c7b611c5999fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a92b100ac14d44aff5e4083a49f5ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:24:00.822490 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-f0949f30-6813-4132-939f-a70fb7fb44e7 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] 10.222.0.27 "GET /compute/v2.1/servers/68f6afb1-87f5-4467-bbdf-b4ce1489541e" status: 200 len: 1566 microversion: 2.1 time: 0.156528 Oct 17 03:24:00.823304 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 526/1015] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:24:00 2022] GET /compute/v2.1/servers/68f6afb1-87f5-4467-bbdf-b4ce1489541e => generated 1566 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:24:01.846475 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-dd61469f-ad9a-4475-8907-8fc1ed514a40 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:24:01.847115 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-dd61469f-ad9a-4475-8907-8fc1ed514a40 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] [instance: 68f6afb1-87f5-4467-bbdf-b4ce1489541e] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:24:01.853561 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-dd61469f-ad9a-4475-8907-8fc1ed514a40 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:24:01.854055 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-dd61469f-ad9a-4475-8907-8fc1ed514a40 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:24:01.854492 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-dd61469f-ad9a-4475-8907-8fc1ed514a40 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:24:01.855215 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-dd61469f-ad9a-4475-8907-8fc1ed514a40 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:24:01.855675 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-dd61469f-ad9a-4475-8907-8fc1ed514a40 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:24:01.856102 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-dd61469f-ad9a-4475-8907-8fc1ed514a40 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:24:01.986046 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-dd61469f-ad9a-4475-8907-8fc1ed514a40 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2969d23a676c4b7fb6c7b611c5999fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a92b100ac14d44aff5e4083a49f5ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:24:01.994121 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-dd61469f-ad9a-4475-8907-8fc1ed514a40 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] 10.222.0.27 "GET /compute/v2.1/servers/68f6afb1-87f5-4467-bbdf-b4ce1489541e" status: 200 len: 1566 microversion: 2.1 time: 0.152204 Oct 17 03:24:01.994728 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 490/1016] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:24:01 2022] GET /compute/v2.1/servers/68f6afb1-87f5-4467-bbdf-b4ce1489541e => generated 1566 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:24:03.018433 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-fd417806-f978-40b0-8303-a957fe2e73a0 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:24:03.019070 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-fd417806-f978-40b0-8303-a957fe2e73a0 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] [instance: 68f6afb1-87f5-4467-bbdf-b4ce1489541e] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:24:03.025456 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-fd417806-f978-40b0-8303-a957fe2e73a0 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:24:03.025936 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-fd417806-f978-40b0-8303-a957fe2e73a0 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:24:03.026366 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-fd417806-f978-40b0-8303-a957fe2e73a0 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:24:03.027089 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-fd417806-f978-40b0-8303-a957fe2e73a0 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:24:03.027543 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-fd417806-f978-40b0-8303-a957fe2e73a0 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:24:03.027966 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-fd417806-f978-40b0-8303-a957fe2e73a0 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:24:03.155239 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-fd417806-f978-40b0-8303-a957fe2e73a0 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2969d23a676c4b7fb6c7b611c5999fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a92b100ac14d44aff5e4083a49f5ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:24:03.163938 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-fd417806-f978-40b0-8303-a957fe2e73a0 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] 10.222.0.27 "GET /compute/v2.1/servers/68f6afb1-87f5-4467-bbdf-b4ce1489541e" status: 200 len: 1566 microversion: 2.1 time: 0.150079 Oct 17 03:24:03.164510 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 527/1017] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:24:03 2022] GET /compute/v2.1/servers/68f6afb1-87f5-4467-bbdf-b4ce1489541e => generated 1566 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:24:04.186299 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-4e977529-9e31-42b7-887d-8b4f567a6853 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:24:04.186916 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-4e977529-9e31-42b7-887d-8b4f567a6853 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] [instance: 68f6afb1-87f5-4467-bbdf-b4ce1489541e] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:24:04.193221 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-4e977529-9e31-42b7-887d-8b4f567a6853 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:24:04.193723 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-4e977529-9e31-42b7-887d-8b4f567a6853 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:24:04.194145 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-4e977529-9e31-42b7-887d-8b4f567a6853 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:24:04.194824 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-4e977529-9e31-42b7-887d-8b4f567a6853 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:24:04.195311 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-4e977529-9e31-42b7-887d-8b4f567a6853 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:24:04.195727 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-4e977529-9e31-42b7-887d-8b4f567a6853 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:24:04.323620 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-4e977529-9e31-42b7-887d-8b4f567a6853 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2969d23a676c4b7fb6c7b611c5999fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a92b100ac14d44aff5e4083a49f5ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:24:04.331295 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-4e977529-9e31-42b7-887d-8b4f567a6853 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] 10.222.0.27 "GET /compute/v2.1/servers/68f6afb1-87f5-4467-bbdf-b4ce1489541e" status: 200 len: 1566 microversion: 2.1 time: 0.148799 Oct 17 03:24:04.331855 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 491/1018] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:24:04 2022] GET /compute/v2.1/servers/68f6afb1-87f5-4467-bbdf-b4ce1489541e => generated 1566 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:24:05.354477 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-a8bc8e2c-b5f0-40b7-bb9b-b4e3e61b62e0 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:24:05.355126 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-a8bc8e2c-b5f0-40b7-bb9b-b4e3e61b62e0 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] [instance: 68f6afb1-87f5-4467-bbdf-b4ce1489541e] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:24:05.362214 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-a8bc8e2c-b5f0-40b7-bb9b-b4e3e61b62e0 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:24:05.362690 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-a8bc8e2c-b5f0-40b7-bb9b-b4e3e61b62e0 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:24:05.363153 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-a8bc8e2c-b5f0-40b7-bb9b-b4e3e61b62e0 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:24:05.363843 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-a8bc8e2c-b5f0-40b7-bb9b-b4e3e61b62e0 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:24:05.364292 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-a8bc8e2c-b5f0-40b7-bb9b-b4e3e61b62e0 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:24:05.364711 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-a8bc8e2c-b5f0-40b7-bb9b-b4e3e61b62e0 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:24:05.493998 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-a8bc8e2c-b5f0-40b7-bb9b-b4e3e61b62e0 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2969d23a676c4b7fb6c7b611c5999fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a92b100ac14d44aff5e4083a49f5ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:24:05.502226 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-a8bc8e2c-b5f0-40b7-bb9b-b4e3e61b62e0 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] 10.222.0.27 "GET /compute/v2.1/servers/68f6afb1-87f5-4467-bbdf-b4ce1489541e" status: 200 len: 1566 microversion: 2.1 time: 0.151674 Oct 17 03:24:05.502795 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 528/1019] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:24:05 2022] GET /compute/v2.1/servers/68f6afb1-87f5-4467-bbdf-b4ce1489541e => generated 1566 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:24:06.524910 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-983bd827-eb38-4219-9a92-0df8476613e8 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:24:06.525497 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-983bd827-eb38-4219-9a92-0df8476613e8 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] [instance: 68f6afb1-87f5-4467-bbdf-b4ce1489541e] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:24:06.531951 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-983bd827-eb38-4219-9a92-0df8476613e8 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:24:06.532371 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-983bd827-eb38-4219-9a92-0df8476613e8 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:24:06.532828 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-983bd827-eb38-4219-9a92-0df8476613e8 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:24:06.533965 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-983bd827-eb38-4219-9a92-0df8476613e8 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:24:06.534450 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-983bd827-eb38-4219-9a92-0df8476613e8 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:24:06.534906 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-983bd827-eb38-4219-9a92-0df8476613e8 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:24:06.661797 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-983bd827-eb38-4219-9a92-0df8476613e8 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2969d23a676c4b7fb6c7b611c5999fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a92b100ac14d44aff5e4083a49f5ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:24:06.669762 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-983bd827-eb38-4219-9a92-0df8476613e8 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] 10.222.0.27 "GET /compute/v2.1/servers/68f6afb1-87f5-4467-bbdf-b4ce1489541e" status: 200 len: 1566 microversion: 2.1 time: 0.148775 Oct 17 03:24:06.670324 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 492/1020] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:24:06 2022] GET /compute/v2.1/servers/68f6afb1-87f5-4467-bbdf-b4ce1489541e => generated 1566 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:24:07.693057 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-4d2be7c0-0d92-40a7-82a9-9666a62c0efc tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:24:07.693672 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-4d2be7c0-0d92-40a7-82a9-9666a62c0efc tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] [instance: 68f6afb1-87f5-4467-bbdf-b4ce1489541e] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:24:07.700149 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-4d2be7c0-0d92-40a7-82a9-9666a62c0efc tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:24:07.700634 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-4d2be7c0-0d92-40a7-82a9-9666a62c0efc tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:24:07.701101 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-4d2be7c0-0d92-40a7-82a9-9666a62c0efc tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:24:07.701798 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-4d2be7c0-0d92-40a7-82a9-9666a62c0efc tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:24:07.702258 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-4d2be7c0-0d92-40a7-82a9-9666a62c0efc tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:24:07.702687 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-4d2be7c0-0d92-40a7-82a9-9666a62c0efc tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:24:07.834855 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-4d2be7c0-0d92-40a7-82a9-9666a62c0efc tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2969d23a676c4b7fb6c7b611c5999fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a92b100ac14d44aff5e4083a49f5ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:24:07.842505 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-4d2be7c0-0d92-40a7-82a9-9666a62c0efc tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] 10.222.0.27 "GET /compute/v2.1/servers/68f6afb1-87f5-4467-bbdf-b4ce1489541e" status: 200 len: 1566 microversion: 2.1 time: 0.153440 Oct 17 03:24:07.843095 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 529/1021] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:24:07 2022] GET /compute/v2.1/servers/68f6afb1-87f5-4467-bbdf-b4ce1489541e => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:24:08.866989 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-41f26221-7fbf-49c4-aae4-aeaad4b700e1 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:24:08.867596 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-41f26221-7fbf-49c4-aae4-aeaad4b700e1 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] [instance: 68f6afb1-87f5-4467-bbdf-b4ce1489541e] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:24:08.873941 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-41f26221-7fbf-49c4-aae4-aeaad4b700e1 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:24:08.874428 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-41f26221-7fbf-49c4-aae4-aeaad4b700e1 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:24:08.874877 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-41f26221-7fbf-49c4-aae4-aeaad4b700e1 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:24:08.875566 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-41f26221-7fbf-49c4-aae4-aeaad4b700e1 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:24:08.876020 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-41f26221-7fbf-49c4-aae4-aeaad4b700e1 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:24:08.876446 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-41f26221-7fbf-49c4-aae4-aeaad4b700e1 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:24:09.006516 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-41f26221-7fbf-49c4-aae4-aeaad4b700e1 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2969d23a676c4b7fb6c7b611c5999fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a92b100ac14d44aff5e4083a49f5ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:24:09.014238 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-41f26221-7fbf-49c4-aae4-aeaad4b700e1 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] 10.222.0.27 "GET /compute/v2.1/servers/68f6afb1-87f5-4467-bbdf-b4ce1489541e" status: 200 len: 1566 microversion: 2.1 time: 0.151145 Oct 17 03:24:09.014800 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 493/1022] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:24:08 2022] GET /compute/v2.1/servers/68f6afb1-87f5-4467-bbdf-b4ce1489541e => generated 1566 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:24:10.037879 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-12b9bbb3-eee0-4717-a072-161bcfc351cb tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:24:10.038495 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-12b9bbb3-eee0-4717-a072-161bcfc351cb tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] [instance: 68f6afb1-87f5-4467-bbdf-b4ce1489541e] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:24:10.045836 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-12b9bbb3-eee0-4717-a072-161bcfc351cb tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:24:10.046490 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-12b9bbb3-eee0-4717-a072-161bcfc351cb tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:24:10.047037 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-12b9bbb3-eee0-4717-a072-161bcfc351cb tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:24:10.047748 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-12b9bbb3-eee0-4717-a072-161bcfc351cb tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:24:10.048205 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-12b9bbb3-eee0-4717-a072-161bcfc351cb tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:24:10.048656 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-12b9bbb3-eee0-4717-a072-161bcfc351cb tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:24:10.178179 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-12b9bbb3-eee0-4717-a072-161bcfc351cb tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2969d23a676c4b7fb6c7b611c5999fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a92b100ac14d44aff5e4083a49f5ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:24:10.185899 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-12b9bbb3-eee0-4717-a072-161bcfc351cb tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] 10.222.0.27 "GET /compute/v2.1/servers/68f6afb1-87f5-4467-bbdf-b4ce1489541e" status: 200 len: 1566 microversion: 2.1 time: 0.151933 Oct 17 03:24:10.186474 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 530/1023] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:24:10 2022] GET /compute/v2.1/servers/68f6afb1-87f5-4467-bbdf-b4ce1489541e => generated 1566 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:24:11.209631 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-e2fc2e6f-cd9c-43c1-8d54-e80a45eea303 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:24:11.210237 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-e2fc2e6f-cd9c-43c1-8d54-e80a45eea303 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] [instance: 68f6afb1-87f5-4467-bbdf-b4ce1489541e] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:24:11.216937 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-e2fc2e6f-cd9c-43c1-8d54-e80a45eea303 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:24:11.217420 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-e2fc2e6f-cd9c-43c1-8d54-e80a45eea303 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:24:11.217854 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-e2fc2e6f-cd9c-43c1-8d54-e80a45eea303 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:24:11.218546 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-e2fc2e6f-cd9c-43c1-8d54-e80a45eea303 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:24:11.219024 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-e2fc2e6f-cd9c-43c1-8d54-e80a45eea303 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:24:11.219444 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-e2fc2e6f-cd9c-43c1-8d54-e80a45eea303 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:24:11.350662 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-e2fc2e6f-cd9c-43c1-8d54-e80a45eea303 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2969d23a676c4b7fb6c7b611c5999fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a92b100ac14d44aff5e4083a49f5ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:24:11.358289 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-e2fc2e6f-cd9c-43c1-8d54-e80a45eea303 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] 10.222.0.27 "GET /compute/v2.1/servers/68f6afb1-87f5-4467-bbdf-b4ce1489541e" status: 200 len: 1566 microversion: 2.1 time: 0.152670 Oct 17 03:24:11.358850 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 494/1024] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:24:11 2022] GET /compute/v2.1/servers/68f6afb1-87f5-4467-bbdf-b4ce1489541e => generated 1566 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:24:12.381828 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-9df43d5e-e0d3-487f-899c-0f0696833114 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:24:12.382432 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-9df43d5e-e0d3-487f-899c-0f0696833114 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] [instance: 68f6afb1-87f5-4467-bbdf-b4ce1489541e] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:24:12.389057 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-9df43d5e-e0d3-487f-899c-0f0696833114 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:24:12.389544 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-9df43d5e-e0d3-487f-899c-0f0696833114 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:24:12.389977 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-9df43d5e-e0d3-487f-899c-0f0696833114 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:24:12.390680 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-9df43d5e-e0d3-487f-899c-0f0696833114 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:24:12.391156 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-9df43d5e-e0d3-487f-899c-0f0696833114 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:24:12.391582 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-9df43d5e-e0d3-487f-899c-0f0696833114 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:24:12.532016 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-9df43d5e-e0d3-487f-899c-0f0696833114 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2969d23a676c4b7fb6c7b611c5999fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a92b100ac14d44aff5e4083a49f5ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:24:12.540619 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-9df43d5e-e0d3-487f-899c-0f0696833114 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] 10.222.0.27 "GET /compute/v2.1/servers/68f6afb1-87f5-4467-bbdf-b4ce1489541e" status: 200 len: 1566 microversion: 2.1 time: 0.162609 Oct 17 03:24:12.541190 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 531/1025] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:24:12 2022] GET /compute/v2.1/servers/68f6afb1-87f5-4467-bbdf-b4ce1489541e => generated 1566 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:24:13.565247 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-76f5154c-124a-4d1a-a3ab-f299be690f6b tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:24:13.565850 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-76f5154c-124a-4d1a-a3ab-f299be690f6b tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] [instance: 68f6afb1-87f5-4467-bbdf-b4ce1489541e] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:24:13.572267 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-76f5154c-124a-4d1a-a3ab-f299be690f6b tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:24:13.572737 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-76f5154c-124a-4d1a-a3ab-f299be690f6b tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:24:13.573161 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-76f5154c-124a-4d1a-a3ab-f299be690f6b tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:24:13.573841 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-76f5154c-124a-4d1a-a3ab-f299be690f6b tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:24:13.574287 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-76f5154c-124a-4d1a-a3ab-f299be690f6b tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:24:13.574701 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-76f5154c-124a-4d1a-a3ab-f299be690f6b tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:24:13.704637 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-76f5154c-124a-4d1a-a3ab-f299be690f6b tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2969d23a676c4b7fb6c7b611c5999fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a92b100ac14d44aff5e4083a49f5ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:24:13.712271 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-76f5154c-124a-4d1a-a3ab-f299be690f6b tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] 10.222.0.27 "GET /compute/v2.1/servers/68f6afb1-87f5-4467-bbdf-b4ce1489541e" status: 200 len: 1507 microversion: 2.1 time: 0.151546 Oct 17 03:24:13.712827 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 495/1026] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:24:13 2022] GET /compute/v2.1/servers/68f6afb1-87f5-4467-bbdf-b4ce1489541e => generated 1507 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:24:13.734096 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-9b813224-218d-4aae-b7a5-6f93cf35aa5e tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:24:13.734712 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-9b813224-218d-4aae-b7a5-6f93cf35aa5e tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] [instance: 68f6afb1-87f5-4467-bbdf-b4ce1489541e] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:24:13.741608 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-9b813224-218d-4aae-b7a5-6f93cf35aa5e tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:24:13.742087 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-9b813224-218d-4aae-b7a5-6f93cf35aa5e tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:24:13.742527 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-9b813224-218d-4aae-b7a5-6f93cf35aa5e tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:24:13.743240 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-9b813224-218d-4aae-b7a5-6f93cf35aa5e tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:24:13.743689 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-9b813224-218d-4aae-b7a5-6f93cf35aa5e tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:24:13.744111 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-9b813224-218d-4aae-b7a5-6f93cf35aa5e tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:24:13.772326 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-9b813224-218d-4aae-b7a5-6f93cf35aa5e tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] [instance: 68f6afb1-87f5-4467-bbdf-b4ce1489541e] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=118886) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 17 03:24:13.835527 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-9b813224-218d-4aae-b7a5-6f93cf35aa5e tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] 10.222.0.27 "POST /compute/v2.1/servers/68f6afb1-87f5-4467-bbdf-b4ce1489541e/action" status: 202 len: 0 microversion: 2.1 time: 0.105375 Oct 17 03:24:13.836133 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 532/1027] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 17 03:24:13 2022] POST /compute/v2.1/servers/68f6afb1-87f5-4467-bbdf-b4ce1489541e/action => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 03:24:13.844050 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-411e6202-00b9-4cf1-9ef5-418ad6a9c120 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:24:13.844661 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-411e6202-00b9-4cf1-9ef5-418ad6a9c120 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] [instance: 68f6afb1-87f5-4467-bbdf-b4ce1489541e] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:24:13.851076 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-411e6202-00b9-4cf1-9ef5-418ad6a9c120 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:24:13.851567 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-411e6202-00b9-4cf1-9ef5-418ad6a9c120 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:24:13.852000 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-411e6202-00b9-4cf1-9ef5-418ad6a9c120 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:24:13.852699 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-411e6202-00b9-4cf1-9ef5-418ad6a9c120 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:24:13.853157 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-411e6202-00b9-4cf1-9ef5-418ad6a9c120 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:24:13.853581 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-411e6202-00b9-4cf1-9ef5-418ad6a9c120 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:24:13.984544 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-411e6202-00b9-4cf1-9ef5-418ad6a9c120 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2969d23a676c4b7fb6c7b611c5999fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a92b100ac14d44aff5e4083a49f5ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:24:13.993146 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-411e6202-00b9-4cf1-9ef5-418ad6a9c120 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] 10.222.0.27 "GET /compute/v2.1/servers/68f6afb1-87f5-4467-bbdf-b4ce1489541e" status: 200 len: 1515 microversion: 2.1 time: 0.152771 Oct 17 03:24:13.993574 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 496/1028] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:24:13 2022] GET /compute/v2.1/servers/68f6afb1-87f5-4467-bbdf-b4ce1489541e => generated 1515 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:24:15.018115 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-15868ce4-b82a-4310-a947-d790dd92247f tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:24:15.018729 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-15868ce4-b82a-4310-a947-d790dd92247f tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] [instance: 68f6afb1-87f5-4467-bbdf-b4ce1489541e] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:24:15.025505 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-15868ce4-b82a-4310-a947-d790dd92247f tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:24:15.025986 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-15868ce4-b82a-4310-a947-d790dd92247f tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:24:15.026412 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-15868ce4-b82a-4310-a947-d790dd92247f tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:24:15.027294 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-15868ce4-b82a-4310-a947-d790dd92247f tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:24:15.027667 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-15868ce4-b82a-4310-a947-d790dd92247f tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:24:15.028088 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-15868ce4-b82a-4310-a947-d790dd92247f tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:24:15.128871 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [req-34c90353-c2ee-4c16-8a2f-de1b4f3a1d71 req-71cd7770-5abc-443e-a7e2-2db4b7778230 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68f6afb1-87f5-4467-bbdf-b4ce1489541e", "name": "network-vif-unplugged", "status": "completed", "tag": "48ec48fa-0118-49a2-bc96-50aad08e84df"}]} {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:24:15.144081 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [req-34c90353-c2ee-4c16-8a2f-de1b4f3a1d71 req-71cd7770-5abc-443e-a7e2-2db4b7778230 service nova] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:24:15.145254 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [req-34c90353-c2ee-4c16-8a2f-de1b4f3a1d71 req-71cd7770-5abc-443e-a7e2-2db4b7778230 service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:24:15.146414 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [req-34c90353-c2ee-4c16-8a2f-de1b4f3a1d71 req-71cd7770-5abc-443e-a7e2-2db4b7778230 service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:24:15.166616 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.compute.server_external_events [req-34c90353-c2ee-4c16-8a2f-de1b4f3a1d71 req-71cd7770-5abc-443e-a7e2-2db4b7778230 service nova] Creating event network-vif-unplugged:48ec48fa-0118-49a2-bc96-50aad08e84df for instance 68f6afb1-87f5-4467-bbdf-b4ce1489541e on hv-cinder-84697 Oct 17 03:24:15.172787 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [req-34c90353-c2ee-4c16-8a2f-de1b4f3a1d71 req-71cd7770-5abc-443e-a7e2-2db4b7778230 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048093 Oct 17 03:24:15.175503 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 497/1029] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 03:24:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 03:24:15.176940 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-15868ce4-b82a-4310-a947-d790dd92247f tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2969d23a676c4b7fb6c7b611c5999fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a92b100ac14d44aff5e4083a49f5ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:24:15.185466 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-15868ce4-b82a-4310-a947-d790dd92247f tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] 10.222.0.27 "GET /compute/v2.1/servers/68f6afb1-87f5-4467-bbdf-b4ce1489541e" status: 200 len: 1517 microversion: 2.1 time: 0.172987 Oct 17 03:24:15.186141 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 533/1030] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:24:15 2022] GET /compute/v2.1/servers/68f6afb1-87f5-4467-bbdf-b4ce1489541e => generated 1517 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:24:16.209548 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-6338030f-cc74-4e2e-be0a-634e3b88bedb tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:24:16.210176 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-6338030f-cc74-4e2e-be0a-634e3b88bedb tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] [instance: 68f6afb1-87f5-4467-bbdf-b4ce1489541e] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:24:16.216834 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-6338030f-cc74-4e2e-be0a-634e3b88bedb tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:24:16.217309 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-6338030f-cc74-4e2e-be0a-634e3b88bedb tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:24:16.217735 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-6338030f-cc74-4e2e-be0a-634e3b88bedb tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:24:16.218477 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-6338030f-cc74-4e2e-be0a-634e3b88bedb tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:24:16.218948 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-6338030f-cc74-4e2e-be0a-634e3b88bedb tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:24:16.219367 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-6338030f-cc74-4e2e-be0a-634e3b88bedb tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:24:16.352644 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-6338030f-cc74-4e2e-be0a-634e3b88bedb tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2969d23a676c4b7fb6c7b611c5999fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a92b100ac14d44aff5e4083a49f5ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:24:16.360486 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-6338030f-cc74-4e2e-be0a-634e3b88bedb tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] 10.222.0.27 "GET /compute/v2.1/servers/68f6afb1-87f5-4467-bbdf-b4ce1489541e" status: 200 len: 1573 microversion: 2.1 time: 0.155250 Oct 17 03:24:16.362088 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 498/1031] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:24:16 2022] GET /compute/v2.1/servers/68f6afb1-87f5-4467-bbdf-b4ce1489541e => generated 1573 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:24:17.384635 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-996412f5-86d8-4613-a927-06d75c949502 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:24:17.385240 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-996412f5-86d8-4613-a927-06d75c949502 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] [instance: 68f6afb1-87f5-4467-bbdf-b4ce1489541e] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:24:17.392433 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-996412f5-86d8-4613-a927-06d75c949502 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:24:17.392919 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-996412f5-86d8-4613-a927-06d75c949502 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:24:17.393353 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-996412f5-86d8-4613-a927-06d75c949502 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:24:17.394041 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-996412f5-86d8-4613-a927-06d75c949502 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:24:17.394495 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-996412f5-86d8-4613-a927-06d75c949502 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:24:17.394944 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-996412f5-86d8-4613-a927-06d75c949502 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:24:17.524802 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-996412f5-86d8-4613-a927-06d75c949502 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2969d23a676c4b7fb6c7b611c5999fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a92b100ac14d44aff5e4083a49f5ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:24:17.532893 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-996412f5-86d8-4613-a927-06d75c949502 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] 10.222.0.27 "GET /compute/v2.1/servers/68f6afb1-87f5-4467-bbdf-b4ce1489541e" status: 200 len: 1573 microversion: 2.1 time: 0.151679 Oct 17 03:24:17.533396 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 534/1032] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:24:17 2022] GET /compute/v2.1/servers/68f6afb1-87f5-4467-bbdf-b4ce1489541e => generated 1573 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:24:18.558548 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-b47f7045-c356-43b1-8829-5768c22e7434 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:24:18.559177 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-b47f7045-c356-43b1-8829-5768c22e7434 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] [instance: 68f6afb1-87f5-4467-bbdf-b4ce1489541e] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:24:18.561278 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 17 03:24:18.561424 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Mon Oct 17 03:24:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/68f6afb1-87f5-4467-bbdf-b4ce1489541e (ip 10.222.0.27) !!! Oct 17 03:24:18.562495 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 17 03:24:18.562654 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Mon Oct 17 03:24:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/68f6afb1-87f5-4467-bbdf-b4ce1489541e (ip 10.222.0.27) !!! Oct 17 03:24:18.570326 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-b47f7045-c356-43b1-8829-5768c22e7434 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:24:18.570812 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-b47f7045-c356-43b1-8829-5768c22e7434 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:24:18.571273 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-b47f7045-c356-43b1-8829-5768c22e7434 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:24:18.571981 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-b47f7045-c356-43b1-8829-5768c22e7434 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:24:18.572426 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-b47f7045-c356-43b1-8829-5768c22e7434 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:24:18.572848 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-b47f7045-c356-43b1-8829-5768c22e7434 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:24:18.703454 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-b47f7045-c356-43b1-8829-5768c22e7434 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2969d23a676c4b7fb6c7b611c5999fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a92b100ac14d44aff5e4083a49f5ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:24:18.711663 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-b47f7045-c356-43b1-8829-5768c22e7434 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] 10.222.0.27 "GET /compute/v2.1/servers/68f6afb1-87f5-4467-bbdf-b4ce1489541e" status: 200 len: 1573 microversion: 2.1 time: 0.157012 Oct 17 03:24:18.712214 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 499/1033] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:24:18 2022] GET /compute/v2.1/servers/68f6afb1-87f5-4467-bbdf-b4ce1489541e => generated 1573 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:24:19.734556 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-194826bf-2879-4c8c-b458-2e1c52ad8dae tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:24:19.735184 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-194826bf-2879-4c8c-b458-2e1c52ad8dae tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] [instance: 68f6afb1-87f5-4467-bbdf-b4ce1489541e] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:24:19.741845 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-194826bf-2879-4c8c-b458-2e1c52ad8dae tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:24:19.742324 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-194826bf-2879-4c8c-b458-2e1c52ad8dae tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:24:19.742754 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-194826bf-2879-4c8c-b458-2e1c52ad8dae tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:24:19.743493 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-194826bf-2879-4c8c-b458-2e1c52ad8dae tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:24:19.743934 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-194826bf-2879-4c8c-b458-2e1c52ad8dae tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:24:19.744352 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-194826bf-2879-4c8c-b458-2e1c52ad8dae tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:24:19.872185 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-194826bf-2879-4c8c-b458-2e1c52ad8dae tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2969d23a676c4b7fb6c7b611c5999fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a92b100ac14d44aff5e4083a49f5ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:24:19.880457 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-194826bf-2879-4c8c-b458-2e1c52ad8dae tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] 10.222.0.27 "GET /compute/v2.1/servers/68f6afb1-87f5-4467-bbdf-b4ce1489541e" status: 200 len: 1573 microversion: 2.1 time: 0.149778 Oct 17 03:24:19.881014 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 535/1034] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:24:19 2022] GET /compute/v2.1/servers/68f6afb1-87f5-4467-bbdf-b4ce1489541e => generated 1573 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:24:20.903849 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-9f165dfe-ef54-45af-b573-4f0772af70be tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:24:20.904452 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-9f165dfe-ef54-45af-b573-4f0772af70be tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] [instance: 68f6afb1-87f5-4467-bbdf-b4ce1489541e] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:24:20.911460 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-9f165dfe-ef54-45af-b573-4f0772af70be tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:24:20.911936 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-9f165dfe-ef54-45af-b573-4f0772af70be tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:24:20.912370 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-9f165dfe-ef54-45af-b573-4f0772af70be tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:24:20.913051 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-9f165dfe-ef54-45af-b573-4f0772af70be tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:24:20.913498 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-9f165dfe-ef54-45af-b573-4f0772af70be tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:24:20.913916 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-9f165dfe-ef54-45af-b573-4f0772af70be tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:24:21.047184 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-9f165dfe-ef54-45af-b573-4f0772af70be tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2969d23a676c4b7fb6c7b611c5999fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a92b100ac14d44aff5e4083a49f5ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:24:21.055857 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-9f165dfe-ef54-45af-b573-4f0772af70be tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] 10.222.0.27 "GET /compute/v2.1/servers/68f6afb1-87f5-4467-bbdf-b4ce1489541e" status: 200 len: 1573 microversion: 2.1 time: 0.155586 Oct 17 03:24:21.056773 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 500/1035] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:24:20 2022] GET /compute/v2.1/servers/68f6afb1-87f5-4467-bbdf-b4ce1489541e => generated 1573 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:24:22.080164 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-65ada458-11ae-4734-bff3-0b8494de108f tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:24:22.080763 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-65ada458-11ae-4734-bff3-0b8494de108f tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] [instance: 68f6afb1-87f5-4467-bbdf-b4ce1489541e] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:24:22.087249 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-65ada458-11ae-4734-bff3-0b8494de108f tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:24:22.087728 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-65ada458-11ae-4734-bff3-0b8494de108f tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:24:22.088159 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-65ada458-11ae-4734-bff3-0b8494de108f tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:24:22.088834 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-65ada458-11ae-4734-bff3-0b8494de108f tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:24:22.089284 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-65ada458-11ae-4734-bff3-0b8494de108f tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:24:22.089701 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-65ada458-11ae-4734-bff3-0b8494de108f tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:24:22.219879 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-65ada458-11ae-4734-bff3-0b8494de108f tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2969d23a676c4b7fb6c7b611c5999fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a92b100ac14d44aff5e4083a49f5ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:24:22.227489 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-65ada458-11ae-4734-bff3-0b8494de108f tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] 10.222.0.27 "GET /compute/v2.1/servers/68f6afb1-87f5-4467-bbdf-b4ce1489541e" status: 200 len: 1573 microversion: 2.1 time: 0.151780 Oct 17 03:24:22.228047 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 536/1036] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:24:22 2022] GET /compute/v2.1/servers/68f6afb1-87f5-4467-bbdf-b4ce1489541e => generated 1573 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:24:23.249576 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-c5570eb1-1de6-464e-bfc4-e0ee8c1d4d97 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:24:23.250166 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-c5570eb1-1de6-464e-bfc4-e0ee8c1d4d97 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] [instance: 68f6afb1-87f5-4467-bbdf-b4ce1489541e] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:24:23.257260 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-c5570eb1-1de6-464e-bfc4-e0ee8c1d4d97 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:24:23.257857 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-c5570eb1-1de6-464e-bfc4-e0ee8c1d4d97 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:24:23.258296 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-c5570eb1-1de6-464e-bfc4-e0ee8c1d4d97 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:24:23.259028 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-c5570eb1-1de6-464e-bfc4-e0ee8c1d4d97 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:24:23.259488 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-c5570eb1-1de6-464e-bfc4-e0ee8c1d4d97 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:24:23.259914 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-c5570eb1-1de6-464e-bfc4-e0ee8c1d4d97 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:24:23.394770 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-c5570eb1-1de6-464e-bfc4-e0ee8c1d4d97 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2969d23a676c4b7fb6c7b611c5999fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a92b100ac14d44aff5e4083a49f5ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:24:23.402566 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-c5570eb1-1de6-464e-bfc4-e0ee8c1d4d97 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] 10.222.0.27 "GET /compute/v2.1/servers/68f6afb1-87f5-4467-bbdf-b4ce1489541e" status: 200 len: 1573 microversion: 2.1 time: 0.156919 Oct 17 03:24:23.403164 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 501/1037] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:24:23 2022] GET /compute/v2.1/servers/68f6afb1-87f5-4467-bbdf-b4ce1489541e => generated 1573 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:24:24.426623 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-bec01e5e-25fd-4402-b38d-7496ecce5773 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:24:24.427356 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-bec01e5e-25fd-4402-b38d-7496ecce5773 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] [instance: 68f6afb1-87f5-4467-bbdf-b4ce1489541e] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:24:24.433698 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-bec01e5e-25fd-4402-b38d-7496ecce5773 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:24:24.434183 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-bec01e5e-25fd-4402-b38d-7496ecce5773 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:24:24.434648 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-bec01e5e-25fd-4402-b38d-7496ecce5773 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:24:24.435376 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-bec01e5e-25fd-4402-b38d-7496ecce5773 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:24:24.435828 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-bec01e5e-25fd-4402-b38d-7496ecce5773 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:24:24.436252 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-bec01e5e-25fd-4402-b38d-7496ecce5773 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:24:24.564622 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-bec01e5e-25fd-4402-b38d-7496ecce5773 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2969d23a676c4b7fb6c7b611c5999fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a92b100ac14d44aff5e4083a49f5ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:24:24.572344 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-bec01e5e-25fd-4402-b38d-7496ecce5773 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] 10.222.0.27 "GET /compute/v2.1/servers/68f6afb1-87f5-4467-bbdf-b4ce1489541e" status: 200 len: 1573 microversion: 2.1 time: 0.150170 Oct 17 03:24:24.572968 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 537/1038] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:24:24 2022] GET /compute/v2.1/servers/68f6afb1-87f5-4467-bbdf-b4ce1489541e => generated 1573 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:24:25.196017 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [req-13bd79fe-f45e-445c-a814-939172f88454 req-42d62d50-133a-44d3-8d5d-89f58ab8ad2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68f6afb1-87f5-4467-bbdf-b4ce1489541e", "name": "network-vif-plugged", "status": "completed", "tag": "48ec48fa-0118-49a2-bc96-50aad08e84df"}]} {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:24:25.207317 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [req-13bd79fe-f45e-445c-a814-939172f88454 req-42d62d50-133a-44d3-8d5d-89f58ab8ad2d service nova] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:24:25.207793 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [req-13bd79fe-f45e-445c-a814-939172f88454 req-42d62d50-133a-44d3-8d5d-89f58ab8ad2d service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:24:25.208215 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [req-13bd79fe-f45e-445c-a814-939172f88454 req-42d62d50-133a-44d3-8d5d-89f58ab8ad2d service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:24:25.222471 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.compute.server_external_events [req-13bd79fe-f45e-445c-a814-939172f88454 req-42d62d50-133a-44d3-8d5d-89f58ab8ad2d service nova] Creating event network-vif-plugged:48ec48fa-0118-49a2-bc96-50aad08e84df for instance 68f6afb1-87f5-4467-bbdf-b4ce1489541e on hv-cinder-84697 Oct 17 03:24:25.227473 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [req-13bd79fe-f45e-445c-a814-939172f88454 req-42d62d50-133a-44d3-8d5d-89f58ab8ad2d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035075 Oct 17 03:24:25.228066 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 502/1039] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 03:24:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:24:25.595294 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-39b916d6-9a5c-48d3-9325-1f560e9c5e36 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:24:25.595901 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-39b916d6-9a5c-48d3-9325-1f560e9c5e36 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] [instance: 68f6afb1-87f5-4467-bbdf-b4ce1489541e] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:24:25.602283 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-39b916d6-9a5c-48d3-9325-1f560e9c5e36 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:24:25.602759 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-39b916d6-9a5c-48d3-9325-1f560e9c5e36 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:24:25.603220 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-39b916d6-9a5c-48d3-9325-1f560e9c5e36 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:24:25.603901 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-39b916d6-9a5c-48d3-9325-1f560e9c5e36 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:24:25.604343 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-39b916d6-9a5c-48d3-9325-1f560e9c5e36 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:24:25.604760 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-39b916d6-9a5c-48d3-9325-1f560e9c5e36 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:24:25.622777 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG dbcounter [-] [118886] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:24:25.739318 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-39b916d6-9a5c-48d3-9325-1f560e9c5e36 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2969d23a676c4b7fb6c7b611c5999fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a92b100ac14d44aff5e4083a49f5ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:24:25.746922 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-39b916d6-9a5c-48d3-9325-1f560e9c5e36 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] 10.222.0.27 "GET /compute/v2.1/servers/68f6afb1-87f5-4467-bbdf-b4ce1489541e" status: 200 len: 1573 microversion: 2.1 time: 0.155467 Oct 17 03:24:25.747481 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 538/1040] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:24:25 2022] GET /compute/v2.1/servers/68f6afb1-87f5-4467-bbdf-b4ce1489541e => generated 1573 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:24:26.771839 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-510d4759-2ba9-40c3-a846-2db28fe57ae4 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:24:26.772555 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-510d4759-2ba9-40c3-a846-2db28fe57ae4 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] [instance: 68f6afb1-87f5-4467-bbdf-b4ce1489541e] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:24:26.778686 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-510d4759-2ba9-40c3-a846-2db28fe57ae4 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:24:26.779208 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-510d4759-2ba9-40c3-a846-2db28fe57ae4 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:24:26.779645 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-510d4759-2ba9-40c3-a846-2db28fe57ae4 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:24:26.780342 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-510d4759-2ba9-40c3-a846-2db28fe57ae4 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:24:26.780873 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-510d4759-2ba9-40c3-a846-2db28fe57ae4 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:24:26.781270 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-510d4759-2ba9-40c3-a846-2db28fe57ae4 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:24:26.912663 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-510d4759-2ba9-40c3-a846-2db28fe57ae4 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2969d23a676c4b7fb6c7b611c5999fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a92b100ac14d44aff5e4083a49f5ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:24:26.920947 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-510d4759-2ba9-40c3-a846-2db28fe57ae4 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] 10.222.0.27 "GET /compute/v2.1/servers/68f6afb1-87f5-4467-bbdf-b4ce1489541e" status: 200 len: 1573 microversion: 2.1 time: 0.154456 Oct 17 03:24:26.921906 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 503/1041] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:24:26 2022] GET /compute/v2.1/servers/68f6afb1-87f5-4467-bbdf-b4ce1489541e => generated 1573 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:24:27.945403 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-22ca86a6-416c-49f4-ae31-e54f61f923d4 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:24:27.946298 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-22ca86a6-416c-49f4-ae31-e54f61f923d4 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] [instance: 68f6afb1-87f5-4467-bbdf-b4ce1489541e] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:24:27.952661 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-22ca86a6-416c-49f4-ae31-e54f61f923d4 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:24:27.953135 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-22ca86a6-416c-49f4-ae31-e54f61f923d4 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:24:27.953562 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-22ca86a6-416c-49f4-ae31-e54f61f923d4 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:24:27.954848 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-22ca86a6-416c-49f4-ae31-e54f61f923d4 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:24:27.955315 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-22ca86a6-416c-49f4-ae31-e54f61f923d4 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:24:27.955735 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-22ca86a6-416c-49f4-ae31-e54f61f923d4 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:24:28.085486 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-22ca86a6-416c-49f4-ae31-e54f61f923d4 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2969d23a676c4b7fb6c7b611c5999fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a92b100ac14d44aff5e4083a49f5ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:24:28.093095 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-22ca86a6-416c-49f4-ae31-e54f61f923d4 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] 10.222.0.27 "GET /compute/v2.1/servers/68f6afb1-87f5-4467-bbdf-b4ce1489541e" status: 200 len: 1560 microversion: 2.1 time: 0.151709 Oct 17 03:24:28.093681 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 539/1042] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:24:27 2022] GET /compute/v2.1/servers/68f6afb1-87f5-4467-bbdf-b4ce1489541e => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:24:33.897131 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-99362990-24b2-4677-93e7-45e13c801d80 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-713960255", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-153764123", "security_groups": [{"name": "tempest-secgroup-smoke-1985794598"}], "block_device_mapping_v2": [{"uuid": "98cff82a-cd15-4770-9bfd-b35c034df685", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "69ff13bb-8fa5-45c4-abfd-0eaaeb12e4cd"}]}} {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:24:33.908320 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG dbcounter [-] [118887] Writing DB stats nova_api:SELECT=31 {{(pid=118887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:24:34.010480 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.network.neutron [None req-99362990-24b2-4677-93e7-45e13c801d80 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] validate_networks() for [('69ff13bb-8fa5-45c4-abfd-0eaaeb12e4cd', None, None, None, None, None)] {{(pid=118887) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 03:24:34.686671 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.virt.hardware [None req-99362990-24b2-4677-93e7-45e13c801d80 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Flavor limits 0:0:0 {{(pid=118887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 03:24:34.687128 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.virt.hardware [None req-99362990-24b2-4677-93e7-45e13c801d80 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Image limits 0:0:0 {{(pid=118887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 03:24:34.688638 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.virt.hardware [None req-99362990-24b2-4677-93e7-45e13c801d80 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Flavor pref 0:0:0 {{(pid=118887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 03:24:34.688779 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.virt.hardware [None req-99362990-24b2-4677-93e7-45e13c801d80 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Image pref 0:0:0 {{(pid=118887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 03:24:34.689149 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.virt.hardware [None req-99362990-24b2-4677-93e7-45e13c801d80 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 03:24:34.697833 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-99362990-24b2-4677-93e7-45e13c801d80 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:24:34.698312 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-99362990-24b2-4677-93e7-45e13c801d80 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:24:34.698739 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-99362990-24b2-4677-93e7-45e13c801d80 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:24:34.699496 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-99362990-24b2-4677-93e7-45e13c801d80 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:24:34.699946 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-99362990-24b2-4677-93e7-45e13c801d80 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:24:34.700392 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-99362990-24b2-4677-93e7-45e13c801d80 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:24:34.706974 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG dbcounter [-] [118887] Writing DB stats nova_cell1:SELECT=83 {{(pid=118887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:24:34.717983 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.quota [None req-99362990-24b2-4677-93e7-45e13c801d80 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Getting quotas for project 917f1029c33f4607b398287532f2fb4b. Resources: {'instances', 'cores', 'ram'} {{(pid=118887) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 03:24:34.722296 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.quota [None req-99362990-24b2-4677-93e7-45e13c801d80 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Getting quotas for user 4d30a0379df643ff81e1ca01f3e26d3d and project 917f1029c33f4607b398287532f2fb4b. Resources: {'instances', 'cores', 'ram'} {{(pid=118887) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 03:24:34.779099 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-99362990-24b2-4677-93e7-45e13c801d80 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Going to run 1 instances... {{(pid=118887) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 03:24:34.781196 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-99362990-24b2-4677-93e7-45e13c801d80 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] [instance: c215fefd-2ded-425a-a47b-8a7c833980ac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='98cff82a-cd15-4770-9bfd-b35c034df685',volume_size=None,volume_type=None)] {{(pid=118887) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 03:24:34.907124 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-99362990-24b2-4677-93e7-45e13c801d80 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.013152 Oct 17 03:24:34.908028 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 504/1043] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 17 03:24:33 2022] POST /compute/v2.1/servers => generated 406 bytes in 1015 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 03:24:34.919036 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-7a28436d-b760-485e-afbc-339c53aa17e0 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:24:34.919656 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-7a28436d-b760-485e-afbc-339c53aa17e0 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] [instance: c215fefd-2ded-425a-a47b-8a7c833980ac] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:24:34.922779 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG dbcounter [-] [118886] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=118886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:24:34.977083 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-7a28436d-b760-485e-afbc-339c53aa17e0 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30a0379df643ff81e1ca01f3e26d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '917f1029c33f4607b398287532f2fb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:24:34.983729 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-7a28436d-b760-485e-afbc-339c53aa17e0 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] 10.222.0.27 "GET /compute/v2.1/servers/c215fefd-2ded-425a-a47b-8a7c833980ac" status: 200 len: 1093 microversion: 2.1 time: 0.068678 Oct 17 03:24:34.984289 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 540/1044] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:24:34 2022] GET /compute/v2.1/servers/c215fefd-2ded-425a-a47b-8a7c833980ac => generated 1093 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:24:36.008274 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-9a0eb0fb-f7bd-475d-b82b-f8455f450593 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:24:36.009215 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-9a0eb0fb-f7bd-475d-b82b-f8455f450593 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] [instance: c215fefd-2ded-425a-a47b-8a7c833980ac] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:24:36.015533 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-9a0eb0fb-f7bd-475d-b82b-f8455f450593 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:24:36.016664 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-9a0eb0fb-f7bd-475d-b82b-f8455f450593 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:24:36.017106 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-9a0eb0fb-f7bd-475d-b82b-f8455f450593 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:24:36.017812 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-9a0eb0fb-f7bd-475d-b82b-f8455f450593 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:24:36.018278 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-9a0eb0fb-f7bd-475d-b82b-f8455f450593 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:24:36.018692 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-9a0eb0fb-f7bd-475d-b82b-f8455f450593 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:24:36.089556 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-9a0eb0fb-f7bd-475d-b82b-f8455f450593 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30a0379df643ff81e1ca01f3e26d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '917f1029c33f4607b398287532f2fb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:24:36.098193 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-9a0eb0fb-f7bd-475d-b82b-f8455f450593 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] 10.222.0.27 "GET /compute/v2.1/servers/c215fefd-2ded-425a-a47b-8a7c833980ac" status: 200 len: 1209 microversion: 2.1 time: 0.094250 Oct 17 03:24:36.098856 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 505/1045] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:24:36 2022] GET /compute/v2.1/servers/c215fefd-2ded-425a-a47b-8a7c833980ac => generated 1209 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:24:37.121547 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-6f40ad46-cc02-484c-86a8-578e0d6ecf58 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:24:37.122296 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-6f40ad46-cc02-484c-86a8-578e0d6ecf58 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] [instance: c215fefd-2ded-425a-a47b-8a7c833980ac] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:24:37.129564 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-6f40ad46-cc02-484c-86a8-578e0d6ecf58 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:24:37.129928 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-6f40ad46-cc02-484c-86a8-578e0d6ecf58 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:24:37.130365 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-6f40ad46-cc02-484c-86a8-578e0d6ecf58 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:24:37.131090 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-6f40ad46-cc02-484c-86a8-578e0d6ecf58 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:24:37.131544 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-6f40ad46-cc02-484c-86a8-578e0d6ecf58 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:24:37.131975 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-6f40ad46-cc02-484c-86a8-578e0d6ecf58 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:24:37.268008 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-6f40ad46-cc02-484c-86a8-578e0d6ecf58 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30a0379df643ff81e1ca01f3e26d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '917f1029c33f4607b398287532f2fb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:24:37.275920 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-6f40ad46-cc02-484c-86a8-578e0d6ecf58 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] 10.222.0.27 "GET /compute/v2.1/servers/c215fefd-2ded-425a-a47b-8a7c833980ac" status: 200 len: 1265 microversion: 2.1 time: 0.158203 Oct 17 03:24:37.276488 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 541/1046] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:24:37 2022] GET /compute/v2.1/servers/c215fefd-2ded-425a-a47b-8a7c833980ac => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:24:37.367091 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [req-06c9114e-e580-454a-b12d-6551a2f0364d req-34705e92-7417-419e-bb29-63f0fa40268e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c215fefd-2ded-425a-a47b-8a7c833980ac", "tag": "aabd0a01-3525-4a5d-92bf-64b4665e78bf"}]} {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:24:37.378107 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [req-06c9114e-e580-454a-b12d-6551a2f0364d req-34705e92-7417-419e-bb29-63f0fa40268e service nova] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:24:37.378673 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [req-06c9114e-e580-454a-b12d-6551a2f0364d req-34705e92-7417-419e-bb29-63f0fa40268e service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:24:37.379261 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [req-06c9114e-e580-454a-b12d-6551a2f0364d req-34705e92-7417-419e-bb29-63f0fa40268e service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:24:37.394665 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.compute.server_external_events [req-06c9114e-e580-454a-b12d-6551a2f0364d req-34705e92-7417-419e-bb29-63f0fa40268e service nova] Creating event network-changed:aabd0a01-3525-4a5d-92bf-64b4665e78bf for instance c215fefd-2ded-425a-a47b-8a7c833980ac on hv-cinder-84697 Oct 17 03:24:37.400653 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [req-06c9114e-e580-454a-b12d-6551a2f0364d req-34705e92-7417-419e-bb29-63f0fa40268e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036536 Oct 17 03:24:37.401265 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 506/1047] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 03:24:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:24:38.300884 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-cecb44cb-dd1e-4a42-93d5-5b381ef9da4c tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:24:38.301488 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-cecb44cb-dd1e-4a42-93d5-5b381ef9da4c tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] [instance: c215fefd-2ded-425a-a47b-8a7c833980ac] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:24:38.307820 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-cecb44cb-dd1e-4a42-93d5-5b381ef9da4c tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:24:38.308297 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-cecb44cb-dd1e-4a42-93d5-5b381ef9da4c tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:24:38.308722 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-cecb44cb-dd1e-4a42-93d5-5b381ef9da4c tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:24:38.309409 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-cecb44cb-dd1e-4a42-93d5-5b381ef9da4c tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:24:38.309854 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-cecb44cb-dd1e-4a42-93d5-5b381ef9da4c tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:24:38.310271 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-cecb44cb-dd1e-4a42-93d5-5b381ef9da4c tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:24:38.443745 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-cecb44cb-dd1e-4a42-93d5-5b381ef9da4c tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30a0379df643ff81e1ca01f3e26d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '917f1029c33f4607b398287532f2fb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:24:38.451701 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-cecb44cb-dd1e-4a42-93d5-5b381ef9da4c tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] 10.222.0.27 "GET /compute/v2.1/servers/c215fefd-2ded-425a-a47b-8a7c833980ac" status: 200 len: 1265 microversion: 2.1 time: 0.155291 Oct 17 03:24:38.452271 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 542/1048] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:24:38 2022] GET /compute/v2.1/servers/c215fefd-2ded-425a-a47b-8a7c833980ac => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:24:39.474936 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-6ddc69ba-46cc-4ea1-bf65-6d06e71a2c29 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:24:39.475657 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-6ddc69ba-46cc-4ea1-bf65-6d06e71a2c29 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] [instance: c215fefd-2ded-425a-a47b-8a7c833980ac] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:24:39.482187 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-6ddc69ba-46cc-4ea1-bf65-6d06e71a2c29 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:24:39.482690 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-6ddc69ba-46cc-4ea1-bf65-6d06e71a2c29 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:24:39.483127 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-6ddc69ba-46cc-4ea1-bf65-6d06e71a2c29 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:24:39.483812 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-6ddc69ba-46cc-4ea1-bf65-6d06e71a2c29 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:24:39.484663 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-6ddc69ba-46cc-4ea1-bf65-6d06e71a2c29 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:24:39.484839 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-6ddc69ba-46cc-4ea1-bf65-6d06e71a2c29 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:24:39.612635 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-6ddc69ba-46cc-4ea1-bf65-6d06e71a2c29 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30a0379df643ff81e1ca01f3e26d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '917f1029c33f4607b398287532f2fb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:24:39.620221 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-6ddc69ba-46cc-4ea1-bf65-6d06e71a2c29 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] 10.222.0.27 "GET /compute/v2.1/servers/c215fefd-2ded-425a-a47b-8a7c833980ac" status: 200 len: 1265 microversion: 2.1 time: 0.149770 Oct 17 03:24:39.620776 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 507/1049] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:24:39 2022] GET /compute/v2.1/servers/c215fefd-2ded-425a-a47b-8a7c833980ac => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:24:40.643790 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-d5908446-7cad-4d6f-9cd4-d757a93dfd89 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:24:40.644429 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-d5908446-7cad-4d6f-9cd4-d757a93dfd89 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] [instance: c215fefd-2ded-425a-a47b-8a7c833980ac] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:24:40.650852 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-d5908446-7cad-4d6f-9cd4-d757a93dfd89 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:24:40.651368 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-d5908446-7cad-4d6f-9cd4-d757a93dfd89 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:24:40.651801 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-d5908446-7cad-4d6f-9cd4-d757a93dfd89 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:24:40.652490 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-d5908446-7cad-4d6f-9cd4-d757a93dfd89 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:24:40.652943 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-d5908446-7cad-4d6f-9cd4-d757a93dfd89 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:24:40.653367 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-d5908446-7cad-4d6f-9cd4-d757a93dfd89 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:24:40.785797 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-d5908446-7cad-4d6f-9cd4-d757a93dfd89 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30a0379df643ff81e1ca01f3e26d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '917f1029c33f4607b398287532f2fb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:24:40.793672 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-d5908446-7cad-4d6f-9cd4-d757a93dfd89 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] 10.222.0.27 "GET /compute/v2.1/servers/c215fefd-2ded-425a-a47b-8a7c833980ac" status: 200 len: 1265 microversion: 2.1 time: 0.154297 Oct 17 03:24:40.794260 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 543/1050] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:24:40 2022] GET /compute/v2.1/servers/c215fefd-2ded-425a-a47b-8a7c833980ac => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:24:41.816238 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-4cc8159a-aa52-40d3-b730-eed519e6eda2 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:24:41.816783 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-4cc8159a-aa52-40d3-b730-eed519e6eda2 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] [instance: c215fefd-2ded-425a-a47b-8a7c833980ac] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:24:41.823184 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-4cc8159a-aa52-40d3-b730-eed519e6eda2 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:24:41.823663 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-4cc8159a-aa52-40d3-b730-eed519e6eda2 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:24:41.824095 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-4cc8159a-aa52-40d3-b730-eed519e6eda2 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:24:41.824781 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-4cc8159a-aa52-40d3-b730-eed519e6eda2 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:24:41.825233 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-4cc8159a-aa52-40d3-b730-eed519e6eda2 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:24:41.825656 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-4cc8159a-aa52-40d3-b730-eed519e6eda2 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:24:41.956505 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-4cc8159a-aa52-40d3-b730-eed519e6eda2 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30a0379df643ff81e1ca01f3e26d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '917f1029c33f4607b398287532f2fb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:24:41.964196 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-4cc8159a-aa52-40d3-b730-eed519e6eda2 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] 10.222.0.27 "GET /compute/v2.1/servers/c215fefd-2ded-425a-a47b-8a7c833980ac" status: 200 len: 1265 microversion: 2.1 time: 0.151914 Oct 17 03:24:41.964752 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 508/1051] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:24:41 2022] GET /compute/v2.1/servers/c215fefd-2ded-425a-a47b-8a7c833980ac => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:24:42.987466 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-a5242523-546c-4a1e-ba14-365f4eddc304 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:24:42.988068 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-a5242523-546c-4a1e-ba14-365f4eddc304 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] [instance: c215fefd-2ded-425a-a47b-8a7c833980ac] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:24:42.994369 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-a5242523-546c-4a1e-ba14-365f4eddc304 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:24:42.994842 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-a5242523-546c-4a1e-ba14-365f4eddc304 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:24:42.995299 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-a5242523-546c-4a1e-ba14-365f4eddc304 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:24:42.995975 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-a5242523-546c-4a1e-ba14-365f4eddc304 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:24:42.996422 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-a5242523-546c-4a1e-ba14-365f4eddc304 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:24:42.996835 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-a5242523-546c-4a1e-ba14-365f4eddc304 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:24:43.126545 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-a5242523-546c-4a1e-ba14-365f4eddc304 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30a0379df643ff81e1ca01f3e26d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '917f1029c33f4607b398287532f2fb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:24:43.134209 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-a5242523-546c-4a1e-ba14-365f4eddc304 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] 10.222.0.27 "GET /compute/v2.1/servers/c215fefd-2ded-425a-a47b-8a7c833980ac" status: 200 len: 1265 microversion: 2.1 time: 0.150938 Oct 17 03:24:43.134769 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 544/1052] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:24:42 2022] GET /compute/v2.1/servers/c215fefd-2ded-425a-a47b-8a7c833980ac => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:24:44.157275 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-dd605117-2860-41ea-b61c-96b4391710a2 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:24:44.157931 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-dd605117-2860-41ea-b61c-96b4391710a2 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] [instance: c215fefd-2ded-425a-a47b-8a7c833980ac] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:24:44.164154 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-dd605117-2860-41ea-b61c-96b4391710a2 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:24:44.164623 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-dd605117-2860-41ea-b61c-96b4391710a2 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:24:44.165046 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-dd605117-2860-41ea-b61c-96b4391710a2 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:24:44.165720 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-dd605117-2860-41ea-b61c-96b4391710a2 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:24:44.166162 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-dd605117-2860-41ea-b61c-96b4391710a2 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:24:44.166577 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-dd605117-2860-41ea-b61c-96b4391710a2 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:24:44.296875 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-dd605117-2860-41ea-b61c-96b4391710a2 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30a0379df643ff81e1ca01f3e26d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '917f1029c33f4607b398287532f2fb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:24:44.305301 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-dd605117-2860-41ea-b61c-96b4391710a2 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] 10.222.0.27 "GET /compute/v2.1/servers/c215fefd-2ded-425a-a47b-8a7c833980ac" status: 200 len: 1265 microversion: 2.1 time: 0.151999 Oct 17 03:24:44.306071 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 509/1053] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:24:44 2022] GET /compute/v2.1/servers/c215fefd-2ded-425a-a47b-8a7c833980ac => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:24:45.329124 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-cc3ad4f6-904f-4121-a5f4-eab9597e4f55 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:24:45.330164 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-cc3ad4f6-904f-4121-a5f4-eab9597e4f55 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] [instance: c215fefd-2ded-425a-a47b-8a7c833980ac] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:24:45.332542 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG dbcounter [-] [118886] Writing DB stats nova_cell0:SELECT=2 {{(pid=118886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:24:45.338180 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-cc3ad4f6-904f-4121-a5f4-eab9597e4f55 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:24:45.338668 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-cc3ad4f6-904f-4121-a5f4-eab9597e4f55 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:24:45.339126 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-cc3ad4f6-904f-4121-a5f4-eab9597e4f55 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:24:45.339940 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-cc3ad4f6-904f-4121-a5f4-eab9597e4f55 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:24:45.340398 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-cc3ad4f6-904f-4121-a5f4-eab9597e4f55 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:24:45.340830 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-cc3ad4f6-904f-4121-a5f4-eab9597e4f55 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:24:45.476782 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-cc3ad4f6-904f-4121-a5f4-eab9597e4f55 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30a0379df643ff81e1ca01f3e26d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '917f1029c33f4607b398287532f2fb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:24:45.484430 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-cc3ad4f6-904f-4121-a5f4-eab9597e4f55 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] 10.222.0.27 "GET /compute/v2.1/servers/c215fefd-2ded-425a-a47b-8a7c833980ac" status: 200 len: 1265 microversion: 2.1 time: 0.159283 Oct 17 03:24:45.484998 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 545/1054] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:24:45 2022] GET /compute/v2.1/servers/c215fefd-2ded-425a-a47b-8a7c833980ac => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:24:46.507773 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-7304a7bc-d2fd-4b3b-947b-96ba01ba1f99 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:24:46.508369 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-7304a7bc-d2fd-4b3b-947b-96ba01ba1f99 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] [instance: c215fefd-2ded-425a-a47b-8a7c833980ac] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:24:46.510277 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG dbcounter [-] [118887] Writing DB stats nova_cell0:SELECT=2 {{(pid=118887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:24:46.510949 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG dbcounter [-] [118887] Writing DB stats nova_cell0:SELECT=6 {{(pid=118887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:24:46.517812 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-7304a7bc-d2fd-4b3b-947b-96ba01ba1f99 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:24:46.518289 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-7304a7bc-d2fd-4b3b-947b-96ba01ba1f99 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:24:46.518743 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-7304a7bc-d2fd-4b3b-947b-96ba01ba1f99 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:24:46.519453 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-7304a7bc-d2fd-4b3b-947b-96ba01ba1f99 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:24:46.519899 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-7304a7bc-d2fd-4b3b-947b-96ba01ba1f99 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:24:46.520316 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-7304a7bc-d2fd-4b3b-947b-96ba01ba1f99 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:24:46.653493 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-7304a7bc-d2fd-4b3b-947b-96ba01ba1f99 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30a0379df643ff81e1ca01f3e26d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '917f1029c33f4607b398287532f2fb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:24:46.661278 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-7304a7bc-d2fd-4b3b-947b-96ba01ba1f99 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] 10.222.0.27 "GET /compute/v2.1/servers/c215fefd-2ded-425a-a47b-8a7c833980ac" status: 200 len: 1265 microversion: 2.1 time: 0.157357 Oct 17 03:24:46.661837 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 510/1055] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:24:46 2022] GET /compute/v2.1/servers/c215fefd-2ded-425a-a47b-8a7c833980ac => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:24:47.314935 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [req-02ecbd9b-d960-436e-acd9-3415933f96b8 req-7b3f3752-f8da-416b-8462-17315d47632f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c215fefd-2ded-425a-a47b-8a7c833980ac", "name": "network-vif-plugged", "status": "completed", "tag": "aabd0a01-3525-4a5d-92bf-64b4665e78bf"}]} {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:24:47.326114 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [req-02ecbd9b-d960-436e-acd9-3415933f96b8 req-7b3f3752-f8da-416b-8462-17315d47632f service nova] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:24:47.326602 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [req-02ecbd9b-d960-436e-acd9-3415933f96b8 req-7b3f3752-f8da-416b-8462-17315d47632f service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:24:47.327061 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [req-02ecbd9b-d960-436e-acd9-3415933f96b8 req-7b3f3752-f8da-416b-8462-17315d47632f service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:24:47.338626 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.compute.server_external_events [req-02ecbd9b-d960-436e-acd9-3415933f96b8 req-7b3f3752-f8da-416b-8462-17315d47632f service nova] Creating event network-vif-plugged:aabd0a01-3525-4a5d-92bf-64b4665e78bf for instance c215fefd-2ded-425a-a47b-8a7c833980ac on hv-cinder-84697 Oct 17 03:24:47.343681 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [req-02ecbd9b-d960-436e-acd9-3415933f96b8 req-7b3f3752-f8da-416b-8462-17315d47632f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032467 Oct 17 03:24:47.344331 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 546/1056] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 03:24:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:24:47.684316 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-5883751e-5bbe-4397-adbc-3a23aea4893d tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:24:47.684921 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-5883751e-5bbe-4397-adbc-3a23aea4893d tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] [instance: c215fefd-2ded-425a-a47b-8a7c833980ac] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:24:47.691951 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-5883751e-5bbe-4397-adbc-3a23aea4893d tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:24:47.692440 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-5883751e-5bbe-4397-adbc-3a23aea4893d tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:24:47.692873 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-5883751e-5bbe-4397-adbc-3a23aea4893d tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:24:47.693562 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-5883751e-5bbe-4397-adbc-3a23aea4893d tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:24:47.694018 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-5883751e-5bbe-4397-adbc-3a23aea4893d tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:24:47.694445 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-5883751e-5bbe-4397-adbc-3a23aea4893d tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:24:47.824618 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-5883751e-5bbe-4397-adbc-3a23aea4893d tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30a0379df643ff81e1ca01f3e26d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '917f1029c33f4607b398287532f2fb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:24:47.832917 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-5883751e-5bbe-4397-adbc-3a23aea4893d tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] 10.222.0.27 "GET /compute/v2.1/servers/c215fefd-2ded-425a-a47b-8a7c833980ac" status: 200 len: 1265 microversion: 2.1 time: 0.152493 Oct 17 03:24:47.833486 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 511/1057] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:24:47 2022] GET /compute/v2.1/servers/c215fefd-2ded-425a-a47b-8a7c833980ac => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:24:48.856474 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-01169918-ae6f-4423-a12b-9a527562b07d tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:24:48.857171 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-01169918-ae6f-4423-a12b-9a527562b07d tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] [instance: c215fefd-2ded-425a-a47b-8a7c833980ac] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:24:48.863575 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-01169918-ae6f-4423-a12b-9a527562b07d tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:24:48.864059 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-01169918-ae6f-4423-a12b-9a527562b07d tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:24:48.864495 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-01169918-ae6f-4423-a12b-9a527562b07d tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:24:48.865186 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-01169918-ae6f-4423-a12b-9a527562b07d tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:24:48.865642 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-01169918-ae6f-4423-a12b-9a527562b07d tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:24:48.866071 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-01169918-ae6f-4423-a12b-9a527562b07d tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:24:48.997629 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-01169918-ae6f-4423-a12b-9a527562b07d tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30a0379df643ff81e1ca01f3e26d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '917f1029c33f4607b398287532f2fb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:24:49.005492 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-01169918-ae6f-4423-a12b-9a527562b07d tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] 10.222.0.27 "GET /compute/v2.1/servers/c215fefd-2ded-425a-a47b-8a7c833980ac" status: 200 len: 1452 microversion: 2.1 time: 0.153759 Oct 17 03:24:49.006060 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 547/1058] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:24:48 2022] GET /compute/v2.1/servers/c215fefd-2ded-425a-a47b-8a7c833980ac => generated 1452 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:24:49.027857 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-98956a2d-6ea3-41cb-8817-6e35384504d0 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:24:49.028465 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-98956a2d-6ea3-41cb-8817-6e35384504d0 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] [instance: c215fefd-2ded-425a-a47b-8a7c833980ac] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:24:49.035465 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-98956a2d-6ea3-41cb-8817-6e35384504d0 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:24:49.035944 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-98956a2d-6ea3-41cb-8817-6e35384504d0 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:24:49.036378 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-98956a2d-6ea3-41cb-8817-6e35384504d0 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:24:49.037068 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-98956a2d-6ea3-41cb-8817-6e35384504d0 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:24:49.037524 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-98956a2d-6ea3-41cb-8817-6e35384504d0 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:24:49.037948 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-98956a2d-6ea3-41cb-8817-6e35384504d0 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:24:49.169276 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-98956a2d-6ea3-41cb-8817-6e35384504d0 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30a0379df643ff81e1ca01f3e26d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '917f1029c33f4607b398287532f2fb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:24:49.177187 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-98956a2d-6ea3-41cb-8817-6e35384504d0 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] 10.222.0.27 "GET /compute/v2.1/servers/c215fefd-2ded-425a-a47b-8a7c833980ac" status: 200 len: 1452 microversion: 2.1 time: 0.153117 Oct 17 03:24:49.177758 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 512/1059] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:24:49 2022] GET /compute/v2.1/servers/c215fefd-2ded-425a-a47b-8a7c833980ac => generated 1452 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:24:50.721649 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [req-fba91796-b6aa-4ae3-b866-953c2a0c9263 req-5d46dc6a-5e6b-4c5e-8c22-b7bc463778be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c215fefd-2ded-425a-a47b-8a7c833980ac", "tag": "aabd0a01-3525-4a5d-92bf-64b4665e78bf"}]} {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:24:50.731907 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [req-fba91796-b6aa-4ae3-b866-953c2a0c9263 req-5d46dc6a-5e6b-4c5e-8c22-b7bc463778be service nova] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:24:50.732374 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [req-fba91796-b6aa-4ae3-b866-953c2a0c9263 req-5d46dc6a-5e6b-4c5e-8c22-b7bc463778be service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:24:50.732797 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [req-fba91796-b6aa-4ae3-b866-953c2a0c9263 req-5d46dc6a-5e6b-4c5e-8c22-b7bc463778be service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:24:50.744550 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.compute.server_external_events [req-fba91796-b6aa-4ae3-b866-953c2a0c9263 req-5d46dc6a-5e6b-4c5e-8c22-b7bc463778be service nova] Creating event network-changed:aabd0a01-3525-4a5d-92bf-64b4665e78bf for instance c215fefd-2ded-425a-a47b-8a7c833980ac on hv-cinder-84697 Oct 17 03:24:50.749553 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [req-fba91796-b6aa-4ae3-b866-953c2a0c9263 req-5d46dc6a-5e6b-4c5e-8c22-b7bc463778be service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032478 Oct 17 03:24:50.750572 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 548/1060] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 03:24:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:25:44.400134 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-e1719411-7194-42b9-9420-fae31f224243 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:25:44.400668 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-e1719411-7194-42b9-9420-fae31f224243 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] [instance: 68f6afb1-87f5-4467-bbdf-b4ce1489541e] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:25:44.402942 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG dbcounter [-] [118887] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=3 {{(pid=118887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:25:44.403573 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [req-ab4bdef9-35c9-4b41-b478-b50f220d6133 req-a8401f77-188c-41f3-a3e0-e3fa906c14ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68f6afb1-87f5-4467-bbdf-b4ce1489541e", "tag": "48ec48fa-0118-49a2-bc96-50aad08e84df"}]} {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:25:44.403988 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG dbcounter [-] [118887] Writing DB stats nova_cell1:SELECT=45 {{(pid=118887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:25:44.410902 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG dbcounter [-] [118886] Writing DB stats nova_api:SELECT=19 {{(pid=118886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:25:44.411094 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-e1719411-7194-42b9-9420-fae31f224243 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:25:44.411766 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG dbcounter [-] [118886] Writing DB stats nova_cell1:SELECT=48 {{(pid=118886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:25:44.412574 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-e1719411-7194-42b9-9420-fae31f224243 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:25:44.413079 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-e1719411-7194-42b9-9420-fae31f224243 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:25:44.413828 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-e1719411-7194-42b9-9420-fae31f224243 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:25:44.414614 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-e1719411-7194-42b9-9420-fae31f224243 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:25:44.415255 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-e1719411-7194-42b9-9420-fae31f224243 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:25:44.420010 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [req-ab4bdef9-35c9-4b41-b478-b50f220d6133 req-a8401f77-188c-41f3-a3e0-e3fa906c14ec service nova] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:25:44.421070 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [req-ab4bdef9-35c9-4b41-b478-b50f220d6133 req-a8401f77-188c-41f3-a3e0-e3fa906c14ec service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:25:44.421070 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [req-ab4bdef9-35c9-4b41-b478-b50f220d6133 req-a8401f77-188c-41f3-a3e0-e3fa906c14ec service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:25:44.433345 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.compute.server_external_events [req-ab4bdef9-35c9-4b41-b478-b50f220d6133 req-a8401f77-188c-41f3-a3e0-e3fa906c14ec service nova] Creating event network-changed:48ec48fa-0118-49a2-bc96-50aad08e84df for instance 68f6afb1-87f5-4467-bbdf-b4ce1489541e on hv-cinder-84697 Oct 17 03:25:44.438697 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [req-ab4bdef9-35c9-4b41-b478-b50f220d6133 req-a8401f77-188c-41f3-a3e0-e3fa906c14ec service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039669 Oct 17 03:25:44.440717 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 549/1061] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 03:25:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 03:25:44.442984 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-e1719411-7194-42b9-9420-fae31f224243 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] [instance: 68f6afb1-87f5-4467-bbdf-b4ce1489541e] Going to try to terminate instance {{(pid=118887) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 03:25:44.530733 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-e1719411-7194-42b9-9420-fae31f224243 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] 10.222.0.27 "DELETE /compute/v2.1/servers/68f6afb1-87f5-4467-bbdf-b4ce1489541e" status: 204 len: 0 microversion: 2.1 time: 0.133636 Oct 17 03:25:44.535517 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 513/1062] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 03:25:44 2022] DELETE /compute/v2.1/servers/68f6afb1-87f5-4467-bbdf-b4ce1489541e => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 03:25:44.545266 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-a9ddd93f-f4be-487c-a920-1b86bd75738f tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:25:44.546056 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-a9ddd93f-f4be-487c-a920-1b86bd75738f tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] [instance: 68f6afb1-87f5-4467-bbdf-b4ce1489541e] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:25:44.552757 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-a9ddd93f-f4be-487c-a920-1b86bd75738f tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:25:44.553447 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-a9ddd93f-f4be-487c-a920-1b86bd75738f tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:25:44.553914 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-a9ddd93f-f4be-487c-a920-1b86bd75738f tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:25:44.554622 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-a9ddd93f-f4be-487c-a920-1b86bd75738f tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:25:44.555106 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-a9ddd93f-f4be-487c-a920-1b86bd75738f tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:25:44.555529 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-a9ddd93f-f4be-487c-a920-1b86bd75738f tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:25:44.698880 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-a9ddd93f-f4be-487c-a920-1b86bd75738f tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2969d23a676c4b7fb6c7b611c5999fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a92b100ac14d44aff5e4083a49f5ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:25:44.707451 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-a9ddd93f-f4be-487c-a920-1b86bd75738f tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] 10.222.0.27 "GET /compute/v2.1/servers/68f6afb1-87f5-4467-bbdf-b4ce1489541e" status: 200 len: 1566 microversion: 2.1 time: 0.166662 Oct 17 03:25:44.708026 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 550/1063] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:25:44 2022] GET /compute/v2.1/servers/68f6afb1-87f5-4467-bbdf-b4ce1489541e => generated 1566 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:25:45.732032 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-c7545287-c188-42c9-88fd-9ec60a1dc12c tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:25:45.732732 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-c7545287-c188-42c9-88fd-9ec60a1dc12c tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] [instance: 68f6afb1-87f5-4467-bbdf-b4ce1489541e] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:25:45.739272 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-c7545287-c188-42c9-88fd-9ec60a1dc12c tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:25:45.739759 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-c7545287-c188-42c9-88fd-9ec60a1dc12c tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:25:45.740190 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-c7545287-c188-42c9-88fd-9ec60a1dc12c tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:25:45.740888 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-c7545287-c188-42c9-88fd-9ec60a1dc12c tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:25:45.741339 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-c7545287-c188-42c9-88fd-9ec60a1dc12c tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:25:45.741765 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-c7545287-c188-42c9-88fd-9ec60a1dc12c tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:25:45.874590 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-c7545287-c188-42c9-88fd-9ec60a1dc12c tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2969d23a676c4b7fb6c7b611c5999fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a92b100ac14d44aff5e4083a49f5ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:25:45.882489 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-c7545287-c188-42c9-88fd-9ec60a1dc12c tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] 10.222.0.27 "GET /compute/v2.1/servers/68f6afb1-87f5-4467-bbdf-b4ce1489541e" status: 200 len: 1566 microversion: 2.1 time: 0.154719 Oct 17 03:25:45.883077 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 514/1064] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:25:45 2022] GET /compute/v2.1/servers/68f6afb1-87f5-4467-bbdf-b4ce1489541e => generated 1566 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:25:46.736734 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [req-9f6970af-7001-413e-b272-e8ec286012b8 req-188910b0-9e15-4139-b760-a29c8e818269 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68f6afb1-87f5-4467-bbdf-b4ce1489541e", "name": "network-vif-deleted", "tag": "48ec48fa-0118-49a2-bc96-50aad08e84df"}]} {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:25:46.746648 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [req-9f6970af-7001-413e-b272-e8ec286012b8 req-188910b0-9e15-4139-b760-a29c8e818269 service nova] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:25:46.747149 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [req-9f6970af-7001-413e-b272-e8ec286012b8 req-188910b0-9e15-4139-b760-a29c8e818269 service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:25:46.747568 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [req-9f6970af-7001-413e-b272-e8ec286012b8 req-188910b0-9e15-4139-b760-a29c8e818269 service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:25:46.759602 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.compute.server_external_events [req-9f6970af-7001-413e-b272-e8ec286012b8 req-188910b0-9e15-4139-b760-a29c8e818269 service nova] Creating event network-vif-deleted:48ec48fa-0118-49a2-bc96-50aad08e84df for instance 68f6afb1-87f5-4467-bbdf-b4ce1489541e on hv-cinder-84697 Oct 17 03:25:46.764308 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [req-9f6970af-7001-413e-b272-e8ec286012b8 req-188910b0-9e15-4139-b760-a29c8e818269 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031956 Oct 17 03:25:46.764895 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 551/1065] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 03:25:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:25:46.906180 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-51a1e9eb-ea4d-4058-85de-0a92500e11a0 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:25:46.906705 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-51a1e9eb-ea4d-4058-85de-0a92500e11a0 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] [instance: 68f6afb1-87f5-4467-bbdf-b4ce1489541e] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:25:46.914250 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-51a1e9eb-ea4d-4058-85de-0a92500e11a0 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:25:46.914737 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-51a1e9eb-ea4d-4058-85de-0a92500e11a0 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:25:46.915201 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-51a1e9eb-ea4d-4058-85de-0a92500e11a0 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:25:46.915891 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-51a1e9eb-ea4d-4058-85de-0a92500e11a0 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:25:46.916344 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-51a1e9eb-ea4d-4058-85de-0a92500e11a0 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:25:46.916766 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-51a1e9eb-ea4d-4058-85de-0a92500e11a0 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:25:46.979976 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-51a1e9eb-ea4d-4058-85de-0a92500e11a0 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2969d23a676c4b7fb6c7b611c5999fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a92b100ac14d44aff5e4083a49f5ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:25:46.988490 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-51a1e9eb-ea4d-4058-85de-0a92500e11a0 tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] 10.222.0.27 "GET /compute/v2.1/servers/68f6afb1-87f5-4467-bbdf-b4ce1489541e" status: 200 len: 1218 microversion: 2.1 time: 0.086311 Oct 17 03:25:46.989076 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 515/1066] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:25:46 2022] GET /compute/v2.1/servers/68f6afb1-87f5-4467-bbdf-b4ce1489541e => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:25:48.012343 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-e9efe4ef-c17f-454a-8ce7-c5a40e5fb33e tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:25:48.012960 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-e9efe4ef-c17f-454a-8ce7-c5a40e5fb33e tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] [instance: 68f6afb1-87f5-4467-bbdf-b4ce1489541e] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:25:48.019140 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-e9efe4ef-c17f-454a-8ce7-c5a40e5fb33e tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:25:48.019622 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-e9efe4ef-c17f-454a-8ce7-c5a40e5fb33e tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:25:48.020058 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-e9efe4ef-c17f-454a-8ce7-c5a40e5fb33e tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:25:48.020749 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-e9efe4ef-c17f-454a-8ce7-c5a40e5fb33e tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:25:48.021205 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-e9efe4ef-c17f-454a-8ce7-c5a40e5fb33e tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:25:48.021630 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-e9efe4ef-c17f-454a-8ce7-c5a40e5fb33e tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:25:48.034711 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.wsgi [None req-e9efe4ef-c17f-454a-8ce7-c5a40e5fb33e tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] HTTP exception thrown: Instance 68f6afb1-87f5-4467-bbdf-b4ce1489541e could not be found. Oct 17 03:25:48.036351 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-e9efe4ef-c17f-454a-8ce7-c5a40e5fb33e tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Request method failure captured: Oct 17 03:25:48.036351 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: request: GET /compute/v2.1/servers/68f6afb1-87f5-4467-bbdf-b4ce1489541e HTTP/1.1 Oct 17 03:25:48.036351 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Accept: application/json Oct 17 03:25:48.036351 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Accept-Encoding: identity Oct 17 03:25:48.036351 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Connection: close Oct 17 03:25:48.036351 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Content-Length: 0 Oct 17 03:25:48.036351 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Content-Type: application/json Oct 17 03:25:48.036351 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Host: 10.222.0.27 Oct 17 03:25:48.036351 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Openstack-System-Scope: None Oct 17 03:25:48.036351 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: User-Agent: python-urllib3/1.26.12 Oct 17 03:25:48.036351 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Auth-Token: gAAAAABjTMoyi5TrZj8dEFUm2uIx_LGkVy34MMOzOA5QSBG29VOeFzlpDtBf5JI-9nXiKevudAwLWJeFR922jfHOXcS_7lx3pMJdPlfp-WJIeGqgg06A7VJWou9N5O-QdPVzq7attm70YcmexcYCnvCnO8yxPJ8SM2Z4HRkGm_G9-a1KKhCRpaI Oct 17 03:25:48.036351 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Domain-Id: None Oct 17 03:25:48.036351 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Domain-Name: None Oct 17 03:25:48.036351 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Identity-Status: Confirmed Oct 17 03:25:48.036351 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Is-Admin-Project: True Oct 17 03:25:48.036351 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Project-Domain-Id: default Oct 17 03:25:48.036351 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Project-Domain-Name: Default Oct 17 03:25:48.036351 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Project-Id: f7a92b100ac14d44aff5e4083a49f5ad Oct 17 03:25:48.036351 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Project-Name: tempest-TestShelveInstance-124400440 Oct 17 03:25:48.036351 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Role: member,reader Oct 17 03:25:48.036351 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Roles: member,reader Oct 17 03:25:48.038343 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f7a92b100ac14d44aff5e4083a49f5ad"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f7a92b100ac14d44aff5e4083a49f5ad"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f7a92b100ac14d44aff5e4083a49f5ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f7a92b100ac14d44aff5e4083a49f5ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 17 03:25:48.038343 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Tenant: tempest-TestShelveInstance-124400440 Oct 17 03:25:48.038343 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Tenant-Id: f7a92b100ac14d44aff5e4083a49f5ad Oct 17 03:25:48.038343 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Tenant-Name: tempest-TestShelveInstance-124400440 Oct 17 03:25:48.038343 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-User: tempest-TestShelveInstance-124400440-project Oct 17 03:25:48.038343 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-User-Domain-Id: default Oct 17 03:25:48.038343 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-User-Domain-Name: Default Oct 17 03:25:48.038343 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-User-Id: 2969d23a676c4b7fb6c7b611c5999fa4 Oct 17 03:25:48.038343 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-User-Name: tempest-TestShelveInstance-124400440-project Oct 17 03:25:48.038343 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: method: > Oct 17 03:25:48.038343 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: exception: Instance 68f6afb1-87f5-4467-bbdf-b4ce1489541e could not be found. Oct 17 03:25:48.038343 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: action_args: {'id': '68f6afb1-87f5-4467-bbdf-b4ce1489541e'} Oct 17 03:25:48.039582 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 03:25:48.039582 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:25:48.039582 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 03:25:48.039582 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 03:25:48.039582 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 03:25:48.039582 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 03:25:48.039582 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 03:25:48.039582 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 03:25:48.039582 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 03:25:48.039582 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 03:25:48.039582 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68f6afb1-87f5-4467-bbdf-b4ce1489541e could not be found. Oct 17 03:25:48.039582 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Oct 17 03:25:48.039582 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:25:48.039582 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Oct 17 03:25:48.039582 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:25:48.039582 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:25:48.039582 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:25:48.039582 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 03:25:48.039582 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 03:25:48.039582 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 03:25:48.041275 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 03:25:48.041275 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 03:25:48.041275 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 03:25:48.041275 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 03:25:48.041275 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 03:25:48.041275 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 03:25:48.041275 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 03:25:48.041275 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68f6afb1-87f5-4467-bbdf-b4ce1489541e could not be found. Oct 17 03:25:48.041275 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Oct 17 03:25:48.041275 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:25:48.041275 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Oct 17 03:25:48.041275 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:25:48.041275 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:25:48.041275 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:25:48.041275 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 03:25:48.041275 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 03:25:48.041275 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68f6afb1-87f5-4467-bbdf-b4ce1489541e could not be found. Oct 17 03:25:48.041275 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Oct 17 03:25:48.042830 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-e9efe4ef-c17f-454a-8ce7-c5a40e5fb33e tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Returning 404 to user: Instance 68f6afb1-87f5-4467-bbdf-b4ce1489541e could not be found. {{(pid=118886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 03:25:48.042830 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-e9efe4ef-c17f-454a-8ce7-c5a40e5fb33e tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] 10.222.0.27 "GET /compute/v2.1/servers/68f6afb1-87f5-4467-bbdf-b4ce1489541e" status: 404 len: 111 microversion: 2.1 time: 0.030516 Oct 17 03:25:48.042830 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 552/1067] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:25:48 2022] GET /compute/v2.1/servers/68f6afb1-87f5-4467-bbdf-b4ce1489541e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 03:25:48.202238 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-176c75ac-c825-4a85-ac1c-b007782076bb tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] Calling method '.version_select at 0x7fc7017dd670>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:25:48.225845 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-176c75ac-c825-4a85-ac1c-b007782076bb tempest-TestShelveInstance-124400440 tempest-TestShelveInstance-124400440-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-393263813" status: 202 len: 0 microversion: 2.1 time: 0.027432 Oct 17 03:25:48.226756 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 516/1068] 10.222.0.27 () {58 vars in 1251 bytes} [Mon Oct 17 03:25:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-393263813 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 03:26:23.079623 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG dbcounter [-] [118887] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:26:23.080373 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG dbcounter [-] [118887] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:26:23.082681 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-5c331269-e82f-44f9-a336-925962628b7c tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:26:23.083212 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-5c331269-e82f-44f9-a336-925962628b7c tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] [instance: c215fefd-2ded-425a-a47b-8a7c833980ac] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:26:23.086000 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Oct 17 03:26:23.086677 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG dbcounter [-] [118886] Writing DB stats nova_api:SELECT=8 {{(pid=118886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:26:23.087404 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG dbcounter [-] [118886] Writing DB stats nova_cell1:SELECT=12 {{(pid=118886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:26:23.094399 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-5c331269-e82f-44f9-a336-925962628b7c tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:26:23.094905 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-5c331269-e82f-44f9-a336-925962628b7c tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:26:23.095350 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-5c331269-e82f-44f9-a336-925962628b7c tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:26:23.096416 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-5c331269-e82f-44f9-a336-925962628b7c tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:26:23.096972 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-5c331269-e82f-44f9-a336-925962628b7c tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:26:23.098949 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-5c331269-e82f-44f9-a336-925962628b7c tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:26:23.124224 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-5c331269-e82f-44f9-a336-925962628b7c tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] [instance: c215fefd-2ded-425a-a47b-8a7c833980ac] Going to try to terminate instance {{(pid=118886) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 03:26:23.210066 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-5c331269-e82f-44f9-a336-925962628b7c tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] 10.222.0.27 "DELETE /compute/v2.1/servers/c215fefd-2ded-425a-a47b-8a7c833980ac" status: 204 len: 0 microversion: 2.1 time: 0.140501 Oct 17 03:26:23.210774 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 553/1069] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 03:26:23 2022] DELETE /compute/v2.1/servers/c215fefd-2ded-425a-a47b-8a7c833980ac => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 03:26:23.225920 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-e28ee547-08d8-40cd-9f34-78892a566766 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:26:23.226989 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-e28ee547-08d8-40cd-9f34-78892a566766 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] [instance: c215fefd-2ded-425a-a47b-8a7c833980ac] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:26:23.233971 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [req-10a20acd-219b-4361-a137-957207af9065 req-4c3c2e07-ad72-4c12-a2ee-a6bf42702605 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c215fefd-2ded-425a-a47b-8a7c833980ac", "tag": "aabd0a01-3525-4a5d-92bf-64b4665e78bf"}]} {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:26:23.234310 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-e28ee547-08d8-40cd-9f34-78892a566766 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:26:23.234727 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-e28ee547-08d8-40cd-9f34-78892a566766 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:26:23.235185 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-e28ee547-08d8-40cd-9f34-78892a566766 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:26:23.235884 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-e28ee547-08d8-40cd-9f34-78892a566766 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:26:23.236333 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-e28ee547-08d8-40cd-9f34-78892a566766 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:26:23.236770 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-e28ee547-08d8-40cd-9f34-78892a566766 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:26:23.247865 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [req-10a20acd-219b-4361-a137-957207af9065 req-4c3c2e07-ad72-4c12-a2ee-a6bf42702605 service nova] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:26:23.248380 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [req-10a20acd-219b-4361-a137-957207af9065 req-4c3c2e07-ad72-4c12-a2ee-a6bf42702605 service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:26:23.248816 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [req-10a20acd-219b-4361-a137-957207af9065 req-4c3c2e07-ad72-4c12-a2ee-a6bf42702605 service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:26:23.260340 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.compute.server_external_events [req-10a20acd-219b-4361-a137-957207af9065 req-4c3c2e07-ad72-4c12-a2ee-a6bf42702605 service nova] Creating event network-changed:aabd0a01-3525-4a5d-92bf-64b4665e78bf for instance c215fefd-2ded-425a-a47b-8a7c833980ac on hv-cinder-84697 Oct 17 03:26:23.265682 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [req-10a20acd-219b-4361-a137-957207af9065 req-4c3c2e07-ad72-4c12-a2ee-a6bf42702605 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.187188 Oct 17 03:26:23.266615 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 517/1070] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 03:26:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 03:26:23.375100 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-e28ee547-08d8-40cd-9f34-78892a566766 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30a0379df643ff81e1ca01f3e26d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '917f1029c33f4607b398287532f2fb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:26:23.383254 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-e28ee547-08d8-40cd-9f34-78892a566766 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] 10.222.0.27 "GET /compute/v2.1/servers/c215fefd-2ded-425a-a47b-8a7c833980ac" status: 200 len: 1577 microversion: 2.1 time: 0.162779 Oct 17 03:26:23.383942 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 554/1071] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:26:23 2022] GET /compute/v2.1/servers/c215fefd-2ded-425a-a47b-8a7c833980ac => generated 1577 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:26:24.407158 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-2c6b1e80-192a-47d4-b987-53ecaecac008 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:26:24.407845 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-2c6b1e80-192a-47d4-b987-53ecaecac008 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] [instance: c215fefd-2ded-425a-a47b-8a7c833980ac] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:26:24.414368 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-2c6b1e80-192a-47d4-b987-53ecaecac008 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:26:24.414844 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-2c6b1e80-192a-47d4-b987-53ecaecac008 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:26:24.415294 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-2c6b1e80-192a-47d4-b987-53ecaecac008 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:26:24.415976 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-2c6b1e80-192a-47d4-b987-53ecaecac008 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:26:24.416422 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-2c6b1e80-192a-47d4-b987-53ecaecac008 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:26:24.416841 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-2c6b1e80-192a-47d4-b987-53ecaecac008 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:26:24.576108 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-2c6b1e80-192a-47d4-b987-53ecaecac008 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30a0379df643ff81e1ca01f3e26d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '917f1029c33f4607b398287532f2fb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:26:24.583848 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-2c6b1e80-192a-47d4-b987-53ecaecac008 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] 10.222.0.27 "GET /compute/v2.1/servers/c215fefd-2ded-425a-a47b-8a7c833980ac" status: 200 len: 1577 microversion: 2.1 time: 0.181422 Oct 17 03:26:24.584406 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 518/1072] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:26:24 2022] GET /compute/v2.1/servers/c215fefd-2ded-425a-a47b-8a7c833980ac => generated 1577 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:26:25.606585 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-452834b2-7fa6-4dc5-8cd7-c463b6ab4cde tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:26:25.607449 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-452834b2-7fa6-4dc5-8cd7-c463b6ab4cde tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] [instance: c215fefd-2ded-425a-a47b-8a7c833980ac] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:26:25.616862 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [req-9e0efbcc-6a1b-4185-b527-b87964bdc5b6 req-526938fe-64bc-4d26-9207-5f6351b8b7b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c215fefd-2ded-425a-a47b-8a7c833980ac", "name": "network-vif-deleted", "tag": "aabd0a01-3525-4a5d-92bf-64b4665e78bf"}]} {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:26:25.623306 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-452834b2-7fa6-4dc5-8cd7-c463b6ab4cde tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:26:25.623824 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-452834b2-7fa6-4dc5-8cd7-c463b6ab4cde tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:26:25.624262 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-452834b2-7fa6-4dc5-8cd7-c463b6ab4cde tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:26:25.624978 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-452834b2-7fa6-4dc5-8cd7-c463b6ab4cde tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:26:25.625437 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-452834b2-7fa6-4dc5-8cd7-c463b6ab4cde tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:26:25.625935 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-452834b2-7fa6-4dc5-8cd7-c463b6ab4cde tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:26:25.627256 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [req-9e0efbcc-6a1b-4185-b527-b87964bdc5b6 req-526938fe-64bc-4d26-9207-5f6351b8b7b8 service nova] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:26:25.627728 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [req-9e0efbcc-6a1b-4185-b527-b87964bdc5b6 req-526938fe-64bc-4d26-9207-5f6351b8b7b8 service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:26:25.628163 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [req-9e0efbcc-6a1b-4185-b527-b87964bdc5b6 req-526938fe-64bc-4d26-9207-5f6351b8b7b8 service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:26:25.642825 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.compute.server_external_events [req-9e0efbcc-6a1b-4185-b527-b87964bdc5b6 req-526938fe-64bc-4d26-9207-5f6351b8b7b8 service nova] Creating event network-vif-deleted:aabd0a01-3525-4a5d-92bf-64b4665e78bf for instance c215fefd-2ded-425a-a47b-8a7c833980ac on hv-cinder-84697 Oct 17 03:26:25.648808 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [req-9e0efbcc-6a1b-4185-b527-b87964bdc5b6 req-526938fe-64bc-4d26-9207-5f6351b8b7b8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036214 Oct 17 03:26:25.649405 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 519/1073] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 03:26:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:26:25.697430 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-452834b2-7fa6-4dc5-8cd7-c463b6ab4cde tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30a0379df643ff81e1ca01f3e26d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '917f1029c33f4607b398287532f2fb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:26:25.705373 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-452834b2-7fa6-4dc5-8cd7-c463b6ab4cde tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] 10.222.0.27 "GET /compute/v2.1/servers/c215fefd-2ded-425a-a47b-8a7c833980ac" status: 200 len: 1390 microversion: 2.1 time: 0.103193 Oct 17 03:26:25.705937 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 555/1074] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:26:25 2022] GET /compute/v2.1/servers/c215fefd-2ded-425a-a47b-8a7c833980ac => generated 1390 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:26:26.729309 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-1056ffd6-3200-45ab-8170-9b4e4afd5fc8 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:26:26.729994 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-1056ffd6-3200-45ab-8170-9b4e4afd5fc8 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] [instance: c215fefd-2ded-425a-a47b-8a7c833980ac] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:26:26.736165 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-1056ffd6-3200-45ab-8170-9b4e4afd5fc8 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:26:26.736636 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-1056ffd6-3200-45ab-8170-9b4e4afd5fc8 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:26:26.737062 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-1056ffd6-3200-45ab-8170-9b4e4afd5fc8 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:26:26.737764 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-1056ffd6-3200-45ab-8170-9b4e4afd5fc8 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:26:26.738211 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-1056ffd6-3200-45ab-8170-9b4e4afd5fc8 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:26:26.738628 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-1056ffd6-3200-45ab-8170-9b4e4afd5fc8 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:26:26.752149 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.wsgi [None req-1056ffd6-3200-45ab-8170-9b4e4afd5fc8 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] HTTP exception thrown: Instance c215fefd-2ded-425a-a47b-8a7c833980ac could not be found. Oct 17 03:26:26.753738 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-1056ffd6-3200-45ab-8170-9b4e4afd5fc8 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Request method failure captured: Oct 17 03:26:26.753738 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: request: GET /compute/v2.1/servers/c215fefd-2ded-425a-a47b-8a7c833980ac HTTP/1.1 Oct 17 03:26:26.753738 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Accept: application/json Oct 17 03:26:26.753738 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Accept-Encoding: identity Oct 17 03:26:26.753738 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Connection: close Oct 17 03:26:26.753738 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Content-Length: 0 Oct 17 03:26:26.753738 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Content-Type: application/json Oct 17 03:26:26.753738 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Host: 10.222.0.27 Oct 17 03:26:26.753738 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Openstack-System-Scope: None Oct 17 03:26:26.753738 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: User-Agent: python-urllib3/1.26.12 Oct 17 03:26:26.753738 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Auth-Token: gAAAAABjTMncvfJRZ6jaqjvQEu72rGRzqOyTvCUXXOw_jwUs__RklFePBOaej_K29FXepmEa5KO-7far_lFFa-00aLqaSzEPwGH_Rq-wa-qIOahaFhEwJtL7KjAiUerIUNLXnvyTC4umer9EGyI2SilRmeR5MbTaOJvG_YCzdarJi1aQ7wlcFPI Oct 17 03:26:26.753738 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Domain-Id: None Oct 17 03:26:26.753738 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Domain-Name: None Oct 17 03:26:26.753738 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Identity-Status: Confirmed Oct 17 03:26:26.753738 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Is-Admin-Project: True Oct 17 03:26:26.753738 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Project-Domain-Id: default Oct 17 03:26:26.753738 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Project-Domain-Name: Default Oct 17 03:26:26.753738 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Project-Id: 917f1029c33f4607b398287532f2fb4b Oct 17 03:26:26.753738 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Project-Name: tempest-TestVolumeBootPattern-1752265691 Oct 17 03:26:26.753738 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Role: member,reader Oct 17 03:26:26.753738 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Roles: member,reader Oct 17 03:26:26.756338 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/917f1029c33f4607b398287532f2fb4b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/917f1029c33f4607b398287532f2fb4b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/917f1029c33f4607b398287532f2fb4b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_917f1029c33f4607b398287532f2fb4b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 17 03:26:26.756338 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Tenant: tempest-TestVolumeBootPattern-1752265691 Oct 17 03:26:26.756338 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Tenant-Id: 917f1029c33f4607b398287532f2fb4b Oct 17 03:26:26.756338 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Tenant-Name: tempest-TestVolumeBootPattern-1752265691 Oct 17 03:26:26.756338 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-User: tempest-TestVolumeBootPattern-1752265691-project Oct 17 03:26:26.756338 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-User-Domain-Id: default Oct 17 03:26:26.756338 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-User-Domain-Name: Default Oct 17 03:26:26.756338 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-User-Id: 4d30a0379df643ff81e1ca01f3e26d3d Oct 17 03:26:26.756338 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-User-Name: tempest-TestVolumeBootPattern-1752265691-project Oct 17 03:26:26.756338 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: method: > Oct 17 03:26:26.756338 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: exception: Instance c215fefd-2ded-425a-a47b-8a7c833980ac could not be found. Oct 17 03:26:26.756338 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: action_args: {'id': 'c215fefd-2ded-425a-a47b-8a7c833980ac'} Oct 17 03:26:26.757350 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 03:26:26.757350 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:26:26.757350 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 03:26:26.757350 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 03:26:26.757350 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 03:26:26.757350 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 03:26:26.757350 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 03:26:26.757350 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 03:26:26.757350 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 03:26:26.757350 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 03:26:26.757350 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c215fefd-2ded-425a-a47b-8a7c833980ac could not be found. Oct 17 03:26:26.757350 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Oct 17 03:26:26.757350 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:26:26.757350 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Oct 17 03:26:26.757350 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:26:26.757350 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:26:26.757350 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:26:26.757350 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 03:26:26.757350 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 03:26:26.757350 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 03:26:26.759095 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 03:26:26.759095 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 03:26:26.759095 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 03:26:26.759095 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 03:26:26.759095 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 03:26:26.759095 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 03:26:26.759095 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 03:26:26.759095 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c215fefd-2ded-425a-a47b-8a7c833980ac could not be found. Oct 17 03:26:26.759095 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Oct 17 03:26:26.759095 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:26:26.759095 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Oct 17 03:26:26.759095 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:26:26.759095 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:26:26.759095 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:26:26.759095 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 03:26:26.759095 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 03:26:26.759095 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c215fefd-2ded-425a-a47b-8a7c833980ac could not be found. Oct 17 03:26:26.759095 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Oct 17 03:26:26.760821 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-1056ffd6-3200-45ab-8170-9b4e4afd5fc8 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Returning 404 to user: Instance c215fefd-2ded-425a-a47b-8a7c833980ac could not be found. {{(pid=118887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 03:26:26.760821 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-1056ffd6-3200-45ab-8170-9b4e4afd5fc8 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] 10.222.0.27 "GET /compute/v2.1/servers/c215fefd-2ded-425a-a47b-8a7c833980ac" status: 404 len: 111 microversion: 2.1 time: 0.031186 Oct 17 03:26:26.760821 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 520/1075] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:26:26 2022] GET /compute/v2.1/servers/c215fefd-2ded-425a-a47b-8a7c833980ac => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 03:26:30.031419 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-e7460ad2-21a7-4ac2-8032-b5ee957c04cd tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:26:30.032011 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-e7460ad2-21a7-4ac2-8032-b5ee957c04cd tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] [instance: 2e3f89ba-cb21-406a-bd30-004d49d589db] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:26:30.034533 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [req-754748dd-d758-4612-8576-ffcc55385784 req-8395435b-b1b5-44c4-9d9f-2477a05183c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e3f89ba-cb21-406a-bd30-004d49d589db", "tag": "e329b034-354a-460c-a740-22ac7c371ccb"}]} {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:26:30.039306 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-e7460ad2-21a7-4ac2-8032-b5ee957c04cd tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:26:30.039891 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-e7460ad2-21a7-4ac2-8032-b5ee957c04cd tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:26:30.040357 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-e7460ad2-21a7-4ac2-8032-b5ee957c04cd tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:26:30.041117 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-e7460ad2-21a7-4ac2-8032-b5ee957c04cd tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:26:30.041722 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-e7460ad2-21a7-4ac2-8032-b5ee957c04cd tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:26:30.042146 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-e7460ad2-21a7-4ac2-8032-b5ee957c04cd tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:26:30.046070 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [req-754748dd-d758-4612-8576-ffcc55385784 req-8395435b-b1b5-44c4-9d9f-2477a05183c6 service nova] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:26:30.046815 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [req-754748dd-d758-4612-8576-ffcc55385784 req-8395435b-b1b5-44c4-9d9f-2477a05183c6 service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:26:30.047268 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [req-754748dd-d758-4612-8576-ffcc55385784 req-8395435b-b1b5-44c4-9d9f-2477a05183c6 service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:26:30.060223 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.compute.server_external_events [req-754748dd-d758-4612-8576-ffcc55385784 req-8395435b-b1b5-44c4-9d9f-2477a05183c6 service nova] Creating event network-changed:e329b034-354a-460c-a740-22ac7c371ccb for instance 2e3f89ba-cb21-406a-bd30-004d49d589db on hv-cinder-84697 Oct 17 03:26:30.065307 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [req-754748dd-d758-4612-8576-ffcc55385784 req-8395435b-b1b5-44c4-9d9f-2477a05183c6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035254 Oct 17 03:26:30.065897 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 521/1076] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 03:26:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:26:30.069736 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-e7460ad2-21a7-4ac2-8032-b5ee957c04cd tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] [instance: 2e3f89ba-cb21-406a-bd30-004d49d589db] Going to try to terminate instance {{(pid=118886) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 03:26:30.154127 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-e7460ad2-21a7-4ac2-8032-b5ee957c04cd tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] 10.222.0.27 "DELETE /compute/v2.1/servers/2e3f89ba-cb21-406a-bd30-004d49d589db" status: 204 len: 0 microversion: 2.1 time: 0.126076 Oct 17 03:26:30.158434 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 556/1077] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 03:26:30 2022] DELETE /compute/v2.1/servers/2e3f89ba-cb21-406a-bd30-004d49d589db => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 03:26:30.164597 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-12ca5710-2066-4059-8c45-6f580a76c597 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:26:30.165625 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-12ca5710-2066-4059-8c45-6f580a76c597 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] [instance: 2e3f89ba-cb21-406a-bd30-004d49d589db] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:26:30.172092 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-12ca5710-2066-4059-8c45-6f580a76c597 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:26:30.172580 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-12ca5710-2066-4059-8c45-6f580a76c597 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:26:30.173012 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-12ca5710-2066-4059-8c45-6f580a76c597 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:26:30.173708 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-12ca5710-2066-4059-8c45-6f580a76c597 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:26:30.174161 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-12ca5710-2066-4059-8c45-6f580a76c597 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:26:30.174780 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-12ca5710-2066-4059-8c45-6f580a76c597 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:26:30.336946 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.policy [None req-12ca5710-2066-4059-8c45-6f580a76c597 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30a0379df643ff81e1ca01f3e26d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '917f1029c33f4607b398287532f2fb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:26:30.344937 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-12ca5710-2066-4059-8c45-6f580a76c597 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] 10.222.0.27 "GET /compute/v2.1/servers/2e3f89ba-cb21-406a-bd30-004d49d589db" status: 200 len: 1577 microversion: 2.1 time: 0.185700 Oct 17 03:26:30.345496 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 522/1078] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:26:30 2022] GET /compute/v2.1/servers/2e3f89ba-cb21-406a-bd30-004d49d589db => generated 1577 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 03:26:31.370158 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-bd7f1e25-23e9-4b36-91f4-0868dfff2dfd tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:26:31.371133 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-bd7f1e25-23e9-4b36-91f4-0868dfff2dfd tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] [instance: 2e3f89ba-cb21-406a-bd30-004d49d589db] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:26:31.381520 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-bd7f1e25-23e9-4b36-91f4-0868dfff2dfd tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:26:31.382050 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-bd7f1e25-23e9-4b36-91f4-0868dfff2dfd tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:26:31.382481 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-bd7f1e25-23e9-4b36-91f4-0868dfff2dfd tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:26:31.383373 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-bd7f1e25-23e9-4b36-91f4-0868dfff2dfd tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:26:31.383824 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-bd7f1e25-23e9-4b36-91f4-0868dfff2dfd tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:26:31.384289 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-bd7f1e25-23e9-4b36-91f4-0868dfff2dfd tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:26:31.562992 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-bd7f1e25-23e9-4b36-91f4-0868dfff2dfd tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30a0379df643ff81e1ca01f3e26d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '917f1029c33f4607b398287532f2fb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:26:31.571354 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-bd7f1e25-23e9-4b36-91f4-0868dfff2dfd tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] 10.222.0.27 "GET /compute/v2.1/servers/2e3f89ba-cb21-406a-bd30-004d49d589db" status: 200 len: 1577 microversion: 2.1 time: 0.205466 Oct 17 03:26:31.571940 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 557/1079] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:26:31 2022] GET /compute/v2.1/servers/2e3f89ba-cb21-406a-bd30-004d49d589db => generated 1577 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:26:32.270590 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [req-d71cc0db-5e62-4431-bd39-87ba68a4ef84 req-17f7b867-729f-428f-b04a-3e3425b324c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e3f89ba-cb21-406a-bd30-004d49d589db", "name": "network-vif-deleted", "tag": "e329b034-354a-460c-a740-22ac7c371ccb"}]} {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 03:26:32.280668 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [req-d71cc0db-5e62-4431-bd39-87ba68a4ef84 req-17f7b867-729f-428f-b04a-3e3425b324c2 service nova] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:26:32.281140 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [req-d71cc0db-5e62-4431-bd39-87ba68a4ef84 req-17f7b867-729f-428f-b04a-3e3425b324c2 service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:26:32.281559 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [req-d71cc0db-5e62-4431-bd39-87ba68a4ef84 req-17f7b867-729f-428f-b04a-3e3425b324c2 service nova] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:26:32.293523 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.compute.server_external_events [req-d71cc0db-5e62-4431-bd39-87ba68a4ef84 req-17f7b867-729f-428f-b04a-3e3425b324c2 service nova] Creating event network-vif-deleted:e329b034-354a-460c-a740-22ac7c371ccb for instance 2e3f89ba-cb21-406a-bd30-004d49d589db on hv-cinder-84697 Oct 17 03:26:32.298644 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [req-d71cc0db-5e62-4431-bd39-87ba68a4ef84 req-17f7b867-729f-428f-b04a-3e3425b324c2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031759 Oct 17 03:26:32.299264 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 523/1080] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 17 03:26:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 03:26:32.594779 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-4ae23391-510f-4f99-8d5f-4eb0d06ffdc9 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:26:32.595626 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-4ae23391-510f-4f99-8d5f-4eb0d06ffdc9 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] [instance: 2e3f89ba-cb21-406a-bd30-004d49d589db] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:26:32.614383 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-4ae23391-510f-4f99-8d5f-4eb0d06ffdc9 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:26:32.615175 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-4ae23391-510f-4f99-8d5f-4eb0d06ffdc9 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:26:32.615784 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-4ae23391-510f-4f99-8d5f-4eb0d06ffdc9 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:26:32.616702 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-4ae23391-510f-4f99-8d5f-4eb0d06ffdc9 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:26:32.617347 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-4ae23391-510f-4f99-8d5f-4eb0d06ffdc9 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:26:32.617951 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-4ae23391-510f-4f99-8d5f-4eb0d06ffdc9 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:26:32.651561 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-4ae23391-510f-4f99-8d5f-4eb0d06ffdc9 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:26:32.652448 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-4ae23391-510f-4f99-8d5f-4eb0d06ffdc9 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:26:32.653055 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-4ae23391-510f-4f99-8d5f-4eb0d06ffdc9 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:26:32.653669 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.objects.instance [None req-4ae23391-510f-4f99-8d5f-4eb0d06ffdc9 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lazy-loading 'fault' on Instance uuid 2e3f89ba-cb21-406a-bd30-004d49d589db {{(pid=118886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 03:26:32.697877 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.policy [None req-4ae23391-510f-4f99-8d5f-4eb0d06ffdc9 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d30a0379df643ff81e1ca01f3e26d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '917f1029c33f4607b398287532f2fb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 03:26:32.705549 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-4ae23391-510f-4f99-8d5f-4eb0d06ffdc9 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] 10.222.0.27 "GET /compute/v2.1/servers/2e3f89ba-cb21-406a-bd30-004d49d589db" status: 200 len: 1229 microversion: 2.1 time: 0.115128 Oct 17 03:26:32.706108 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 558/1081] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:26:32 2022] GET /compute/v2.1/servers/2e3f89ba-cb21-406a-bd30-004d49d589db => generated 1229 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 03:26:33.729896 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-19809bc2-1281-4ac8-a02a-fbb186801ded tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:26:33.730606 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-19809bc2-1281-4ac8-a02a-fbb186801ded tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] [instance: 2e3f89ba-cb21-406a-bd30-004d49d589db] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:26:33.736783 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-19809bc2-1281-4ac8-a02a-fbb186801ded tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:26:33.737263 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-19809bc2-1281-4ac8-a02a-fbb186801ded tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:26:33.737694 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-19809bc2-1281-4ac8-a02a-fbb186801ded tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:26:33.738412 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-19809bc2-1281-4ac8-a02a-fbb186801ded tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:26:33.739380 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-19809bc2-1281-4ac8-a02a-fbb186801ded tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:26:33.739903 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-19809bc2-1281-4ac8-a02a-fbb186801ded tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:26:33.752917 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.wsgi [None req-19809bc2-1281-4ac8-a02a-fbb186801ded tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] HTTP exception thrown: Instance 2e3f89ba-cb21-406a-bd30-004d49d589db could not be found. Oct 17 03:26:33.755185 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-19809bc2-1281-4ac8-a02a-fbb186801ded tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Request method failure captured: Oct 17 03:26:33.755185 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: request: GET /compute/v2.1/servers/2e3f89ba-cb21-406a-bd30-004d49d589db HTTP/1.1 Oct 17 03:26:33.755185 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Accept: application/json Oct 17 03:26:33.755185 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Accept-Encoding: identity Oct 17 03:26:33.755185 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Connection: close Oct 17 03:26:33.755185 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Content-Length: 0 Oct 17 03:26:33.755185 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Content-Type: application/json Oct 17 03:26:33.755185 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Host: 10.222.0.27 Oct 17 03:26:33.755185 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Openstack-System-Scope: None Oct 17 03:26:33.755185 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: User-Agent: python-urllib3/1.26.12 Oct 17 03:26:33.755185 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Auth-Token: gAAAAABjTMncvfJRZ6jaqjvQEu72rGRzqOyTvCUXXOw_jwUs__RklFePBOaej_K29FXepmEa5KO-7far_lFFa-00aLqaSzEPwGH_Rq-wa-qIOahaFhEwJtL7KjAiUerIUNLXnvyTC4umer9EGyI2SilRmeR5MbTaOJvG_YCzdarJi1aQ7wlcFPI Oct 17 03:26:33.755185 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Domain-Id: None Oct 17 03:26:33.755185 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Domain-Name: None Oct 17 03:26:33.755185 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Identity-Status: Confirmed Oct 17 03:26:33.755185 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Is-Admin-Project: True Oct 17 03:26:33.755185 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Project-Domain-Id: default Oct 17 03:26:33.755185 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Project-Domain-Name: Default Oct 17 03:26:33.755185 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Project-Id: 917f1029c33f4607b398287532f2fb4b Oct 17 03:26:33.755185 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Project-Name: tempest-TestVolumeBootPattern-1752265691 Oct 17 03:26:33.755185 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Role: member,reader Oct 17 03:26:33.755185 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Roles: member,reader Oct 17 03:26:33.756942 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/917f1029c33f4607b398287532f2fb4b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/917f1029c33f4607b398287532f2fb4b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/917f1029c33f4607b398287532f2fb4b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_917f1029c33f4607b398287532f2fb4b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 17 03:26:33.756942 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Tenant: tempest-TestVolumeBootPattern-1752265691 Oct 17 03:26:33.756942 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Tenant-Id: 917f1029c33f4607b398287532f2fb4b Oct 17 03:26:33.756942 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Tenant-Name: tempest-TestVolumeBootPattern-1752265691 Oct 17 03:26:33.756942 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-User: tempest-TestVolumeBootPattern-1752265691-project Oct 17 03:26:33.756942 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-User-Domain-Id: default Oct 17 03:26:33.756942 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-User-Domain-Name: Default Oct 17 03:26:33.756942 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-User-Id: 4d30a0379df643ff81e1ca01f3e26d3d Oct 17 03:26:33.756942 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-User-Name: tempest-TestVolumeBootPattern-1752265691-project Oct 17 03:26:33.756942 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: method: > Oct 17 03:26:33.756942 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: exception: Instance 2e3f89ba-cb21-406a-bd30-004d49d589db could not be found. Oct 17 03:26:33.756942 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: action_args: {'id': '2e3f89ba-cb21-406a-bd30-004d49d589db'} Oct 17 03:26:33.757912 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 03:26:33.757912 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:26:33.757912 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 03:26:33.757912 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 03:26:33.757912 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 03:26:33.757912 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 03:26:33.757912 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 03:26:33.757912 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 03:26:33.757912 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 03:26:33.757912 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 03:26:33.757912 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e3f89ba-cb21-406a-bd30-004d49d589db could not be found. Oct 17 03:26:33.757912 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Oct 17 03:26:33.757912 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:26:33.757912 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Oct 17 03:26:33.757912 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:26:33.757912 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:26:33.757912 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:26:33.757912 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 03:26:33.757912 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 03:26:33.757912 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 03:26:33.759702 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 03:26:33.759702 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 03:26:33.759702 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 03:26:33.759702 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 03:26:33.759702 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 03:26:33.759702 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 03:26:33.759702 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 03:26:33.759702 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e3f89ba-cb21-406a-bd30-004d49d589db could not be found. Oct 17 03:26:33.759702 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Oct 17 03:26:33.759702 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:26:33.759702 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Oct 17 03:26:33.759702 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:26:33.759702 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:26:33.759702 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:26:33.759702 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 03:26:33.759702 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 03:26:33.759702 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e3f89ba-cb21-406a-bd30-004d49d589db could not be found. Oct 17 03:26:33.759702 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Oct 17 03:26:33.761246 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-19809bc2-1281-4ac8-a02a-fbb186801ded tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Returning 404 to user: Instance 2e3f89ba-cb21-406a-bd30-004d49d589db could not be found. {{(pid=118887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 03:26:33.761246 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-19809bc2-1281-4ac8-a02a-fbb186801ded tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] 10.222.0.27 "GET /compute/v2.1/servers/2e3f89ba-cb21-406a-bd30-004d49d589db" status: 404 len: 111 microversion: 2.1 time: 0.031426 Oct 17 03:26:33.761246 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 524/1082] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:26:33 2022] GET /compute/v2.1/servers/2e3f89ba-cb21-406a-bd30-004d49d589db => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 03:26:34.187820 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-d15527d9-4f8d-4049-9d2c-d5d0b3d37364 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Calling method '>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:26:34.188323 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.compute.api [None req-d15527d9-4f8d-4049-9d2c-d5d0b3d37364 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] [instance: 80dda8a9-370d-4ebe-9d60-26a482c38a14] Fetching instance by UUID {{(pid=118886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:26:34.195215 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-d15527d9-4f8d-4049-9d2c-d5d0b3d37364 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:26:34.195696 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-d15527d9-4f8d-4049-9d2c-d5d0b3d37364 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:26:34.196129 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-d15527d9-4f8d-4049-9d2c-d5d0b3d37364 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:26:34.196822 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-d15527d9-4f8d-4049-9d2c-d5d0b3d37364 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:26:34.197274 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-d15527d9-4f8d-4049-9d2c-d5d0b3d37364 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:26:34.197696 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG oslo_concurrency.lockutils [None req-d15527d9-4f8d-4049-9d2c-d5d0b3d37364 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:26:34.211668 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.wsgi [None req-d15527d9-4f8d-4049-9d2c-d5d0b3d37364 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] HTTP exception thrown: Instance 80dda8a9-370d-4ebe-9d60-26a482c38a14 could not be found. Oct 17 03:26:34.213775 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-d15527d9-4f8d-4049-9d2c-d5d0b3d37364 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Request method failure captured: Oct 17 03:26:34.213775 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: request: DELETE /compute/v2.1/servers/80dda8a9-370d-4ebe-9d60-26a482c38a14 HTTP/1.1 Oct 17 03:26:34.213775 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Accept: application/json Oct 17 03:26:34.213775 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Accept-Encoding: identity Oct 17 03:26:34.213775 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Connection: close Oct 17 03:26:34.213775 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Content-Length: 0 Oct 17 03:26:34.213775 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Content-Type: application/json Oct 17 03:26:34.213775 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Host: 10.222.0.27 Oct 17 03:26:34.213775 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: Openstack-System-Scope: None Oct 17 03:26:34.213775 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: User-Agent: python-urllib3/1.26.12 Oct 17 03:26:34.213775 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Auth-Token: gAAAAABjTMncvfJRZ6jaqjvQEu72rGRzqOyTvCUXXOw_jwUs__RklFePBOaej_K29FXepmEa5KO-7far_lFFa-00aLqaSzEPwGH_Rq-wa-qIOahaFhEwJtL7KjAiUerIUNLXnvyTC4umer9EGyI2SilRmeR5MbTaOJvG_YCzdarJi1aQ7wlcFPI Oct 17 03:26:34.213775 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Domain-Id: None Oct 17 03:26:34.213775 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Domain-Name: None Oct 17 03:26:34.213775 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Identity-Status: Confirmed Oct 17 03:26:34.213775 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Is-Admin-Project: True Oct 17 03:26:34.213775 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Project-Domain-Id: default Oct 17 03:26:34.213775 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Project-Domain-Name: Default Oct 17 03:26:34.213775 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Project-Id: 917f1029c33f4607b398287532f2fb4b Oct 17 03:26:34.213775 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Project-Name: tempest-TestVolumeBootPattern-1752265691 Oct 17 03:26:34.213775 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Role: member,reader Oct 17 03:26:34.213775 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Roles: member,reader Oct 17 03:26:34.215369 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/917f1029c33f4607b398287532f2fb4b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/917f1029c33f4607b398287532f2fb4b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/917f1029c33f4607b398287532f2fb4b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_917f1029c33f4607b398287532f2fb4b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 17 03:26:34.215369 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Tenant: tempest-TestVolumeBootPattern-1752265691 Oct 17 03:26:34.215369 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Tenant-Id: 917f1029c33f4607b398287532f2fb4b Oct 17 03:26:34.215369 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-Tenant-Name: tempest-TestVolumeBootPattern-1752265691 Oct 17 03:26:34.215369 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-User: tempest-TestVolumeBootPattern-1752265691-project Oct 17 03:26:34.215369 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-User-Domain-Id: default Oct 17 03:26:34.215369 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-User-Domain-Name: Default Oct 17 03:26:34.215369 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-User-Id: 4d30a0379df643ff81e1ca01f3e26d3d Oct 17 03:26:34.215369 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: X-User-Name: tempest-TestVolumeBootPattern-1752265691-project Oct 17 03:26:34.215369 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: method: > Oct 17 03:26:34.215369 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: exception: Instance 80dda8a9-370d-4ebe-9d60-26a482c38a14 could not be found. Oct 17 03:26:34.215369 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: action_args: {'id': '80dda8a9-370d-4ebe-9d60-26a482c38a14'} Oct 17 03:26:34.216209 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 03:26:34.216209 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:26:34.216209 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 03:26:34.216209 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 03:26:34.216209 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 03:26:34.216209 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 03:26:34.216209 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 03:26:34.216209 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 03:26:34.216209 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 03:26:34.216209 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 03:26:34.216209 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80dda8a9-370d-4ebe-9d60-26a482c38a14 could not be found. Oct 17 03:26:34.216209 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Oct 17 03:26:34.216209 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:26:34.216209 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Oct 17 03:26:34.216209 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:26:34.216209 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:26:34.216209 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:26:34.216209 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 03:26:34.216209 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 03:26:34.216209 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 03:26:34.217812 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 03:26:34.217812 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 03:26:34.217812 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 03:26:34.217812 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 03:26:34.217812 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 03:26:34.217812 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 03:26:34.217812 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 03:26:34.217812 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 03:26:34.217812 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 03:26:34.217812 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80dda8a9-370d-4ebe-9d60-26a482c38a14 could not be found. Oct 17 03:26:34.217812 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Oct 17 03:26:34.217812 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:26:34.217812 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Oct 17 03:26:34.217812 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:26:34.217812 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:26:34.217812 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:26:34.217812 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 03:26:34.217812 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 03:26:34.217812 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80dda8a9-370d-4ebe-9d60-26a482c38a14 could not be found. Oct 17 03:26:34.217812 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: ERROR nova.api.openstack.wsgi Oct 17 03:26:34.219517 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-d15527d9-4f8d-4049-9d2c-d5d0b3d37364 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Returning 404 to user: Instance 80dda8a9-370d-4ebe-9d60-26a482c38a14 could not be found. {{(pid=118886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 03:26:34.219517 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-d15527d9-4f8d-4049-9d2c-d5d0b3d37364 tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] 10.222.0.27 "DELETE /compute/v2.1/servers/80dda8a9-370d-4ebe-9d60-26a482c38a14" status: 404 len: 111 microversion: 2.1 time: 0.031247 Oct 17 03:26:34.219517 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 559/1083] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 17 03:26:34 2022] DELETE /compute/v2.1/servers/80dda8a9-370d-4ebe-9d60-26a482c38a14 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 03:26:34.224542 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-21f6fb82-7c9a-4365-9294-85839aeb52de tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Calling method '>' {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:26:34.225185 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.compute.api [None req-21f6fb82-7c9a-4365-9294-85839aeb52de tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] [instance: 80dda8a9-370d-4ebe-9d60-26a482c38a14] Fetching instance by UUID {{(pid=118887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 03:26:34.231255 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-21f6fb82-7c9a-4365-9294-85839aeb52de tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:26:34.231740 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-21f6fb82-7c9a-4365-9294-85839aeb52de tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:26:34.232180 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-21f6fb82-7c9a-4365-9294-85839aeb52de tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:26:34.232871 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-21f6fb82-7c9a-4365-9294-85839aeb52de tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Acquiring lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 03:26:34.233328 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-21f6fb82-7c9a-4365-9294-85839aeb52de tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 03:26:34.233759 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG oslo_concurrency.lockutils [None req-21f6fb82-7c9a-4365-9294-85839aeb52de tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Lock "bae72ffa-7a7a-461b-9de6-69e8d04af1a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 03:26:34.247069 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.wsgi [None req-21f6fb82-7c9a-4365-9294-85839aeb52de tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] HTTP exception thrown: Instance 80dda8a9-370d-4ebe-9d60-26a482c38a14 could not be found. Oct 17 03:26:34.248581 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-21f6fb82-7c9a-4365-9294-85839aeb52de tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Request method failure captured: Oct 17 03:26:34.248581 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: request: GET /compute/v2.1/servers/80dda8a9-370d-4ebe-9d60-26a482c38a14 HTTP/1.1 Oct 17 03:26:34.248581 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Accept: application/json Oct 17 03:26:34.248581 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Accept-Encoding: identity Oct 17 03:26:34.248581 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Connection: close Oct 17 03:26:34.248581 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Content-Length: 0 Oct 17 03:26:34.248581 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Content-Type: application/json Oct 17 03:26:34.248581 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Host: 10.222.0.27 Oct 17 03:26:34.248581 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: Openstack-System-Scope: None Oct 17 03:26:34.248581 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: User-Agent: python-urllib3/1.26.12 Oct 17 03:26:34.248581 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Auth-Token: gAAAAABjTMncvfJRZ6jaqjvQEu72rGRzqOyTvCUXXOw_jwUs__RklFePBOaej_K29FXepmEa5KO-7far_lFFa-00aLqaSzEPwGH_Rq-wa-qIOahaFhEwJtL7KjAiUerIUNLXnvyTC4umer9EGyI2SilRmeR5MbTaOJvG_YCzdarJi1aQ7wlcFPI Oct 17 03:26:34.248581 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Domain-Id: None Oct 17 03:26:34.248581 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Domain-Name: None Oct 17 03:26:34.248581 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Identity-Status: Confirmed Oct 17 03:26:34.248581 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Is-Admin-Project: True Oct 17 03:26:34.248581 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Project-Domain-Id: default Oct 17 03:26:34.248581 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Project-Domain-Name: Default Oct 17 03:26:34.248581 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Project-Id: 917f1029c33f4607b398287532f2fb4b Oct 17 03:26:34.248581 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Project-Name: tempest-TestVolumeBootPattern-1752265691 Oct 17 03:26:34.248581 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Role: member,reader Oct 17 03:26:34.248581 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Roles: member,reader Oct 17 03:26:34.250333 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/917f1029c33f4607b398287532f2fb4b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/917f1029c33f4607b398287532f2fb4b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/917f1029c33f4607b398287532f2fb4b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_917f1029c33f4607b398287532f2fb4b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 17 03:26:34.250333 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Tenant: tempest-TestVolumeBootPattern-1752265691 Oct 17 03:26:34.250333 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Tenant-Id: 917f1029c33f4607b398287532f2fb4b Oct 17 03:26:34.250333 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-Tenant-Name: tempest-TestVolumeBootPattern-1752265691 Oct 17 03:26:34.250333 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-User: tempest-TestVolumeBootPattern-1752265691-project Oct 17 03:26:34.250333 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-User-Domain-Id: default Oct 17 03:26:34.250333 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-User-Domain-Name: Default Oct 17 03:26:34.250333 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-User-Id: 4d30a0379df643ff81e1ca01f3e26d3d Oct 17 03:26:34.250333 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: X-User-Name: tempest-TestVolumeBootPattern-1752265691-project Oct 17 03:26:34.250333 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: method: > Oct 17 03:26:34.250333 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: exception: Instance 80dda8a9-370d-4ebe-9d60-26a482c38a14 could not be found. Oct 17 03:26:34.250333 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: action_args: {'id': '80dda8a9-370d-4ebe-9d60-26a482c38a14'} Oct 17 03:26:34.251465 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: {{(pid=118887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 03:26:34.251465 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:26:34.251465 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 03:26:34.251465 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 03:26:34.251465 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 03:26:34.251465 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 03:26:34.251465 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 03:26:34.251465 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 03:26:34.251465 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 03:26:34.251465 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 03:26:34.251465 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80dda8a9-370d-4ebe-9d60-26a482c38a14 could not be found. Oct 17 03:26:34.251465 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Oct 17 03:26:34.251465 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:26:34.251465 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Oct 17 03:26:34.251465 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:26:34.251465 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:26:34.251465 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:26:34.251465 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 03:26:34.251465 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 03:26:34.251465 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 03:26:34.253052 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 03:26:34.253052 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 03:26:34.253052 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 03:26:34.253052 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 03:26:34.253052 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 03:26:34.253052 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 03:26:34.253052 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 03:26:34.253052 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80dda8a9-370d-4ebe-9d60-26a482c38a14 could not be found. Oct 17 03:26:34.253052 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Oct 17 03:26:34.253052 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 03:26:34.253052 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Oct 17 03:26:34.253052 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 03:26:34.253052 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 03:26:34.253052 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 03:26:34.253052 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 03:26:34.253052 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 03:26:34.253052 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80dda8a9-370d-4ebe-9d60-26a482c38a14 could not be found. Oct 17 03:26:34.253052 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: ERROR nova.api.openstack.wsgi Oct 17 03:26:34.254557 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: DEBUG nova.api.openstack.wsgi [None req-21f6fb82-7c9a-4365-9294-85839aeb52de tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Returning 404 to user: Instance 80dda8a9-370d-4ebe-9d60-26a482c38a14 could not be found. {{(pid=118887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 03:26:34.254557 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: INFO nova.api.openstack.requestlog [None req-21f6fb82-7c9a-4365-9294-85839aeb52de tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] 10.222.0.27 "GET /compute/v2.1/servers/80dda8a9-370d-4ebe-9d60-26a482c38a14" status: 404 len: 111 microversion: 2.1 time: 0.029886 Oct 17 03:26:34.254557 dv-cinder-846977-2-iscsi devstack@n-api.service[118887]: [pid: 118887|app: 0|req: 525/1084] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 17 03:26:34 2022] GET /compute/v2.1/servers/80dda8a9-370d-4ebe-9d60-26a482c38a14 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 03:26:35.595905 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: DEBUG nova.api.openstack.wsgi [None req-9dee5ff4-6eb3-46cd-a7e2-d9251b1bfc2d tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] Calling method '.version_select at 0x7fc701859310>' {{(pid=118886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 03:26:35.621692 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: INFO nova.api.openstack.requestlog [None req-9dee5ff4-6eb3-46cd-a7e2-d9251b1bfc2d tempest-TestVolumeBootPattern-1752265691 tempest-TestVolumeBootPattern-1752265691-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-153764123" status: 202 len: 0 microversion: 2.1 time: 0.030066 Oct 17 03:26:35.622276 dv-cinder-846977-2-iscsi devstack@n-api.service[118886]: [pid: 118886|app: 0|req: 560/1085] 10.222.0.27 () {58 vars in 1260 bytes} [Mon Oct 17 03:26:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-153764123 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)